2026-02-22T22:13:45.090 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-22T22:13:45.105 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T22:13:45.184 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64197 branch: wip-yuri6-testing-2026-02-22-1629-squid description: rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '64197' kernel: branch: distro kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 30 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri6-testing-2026-02-22-1629-squid ceph: conf: client.0: debug ms: 1 debug objecter: 20 debug rados: 20 global: mon election default strategy: 3 ms type: async osd debug inject dispatch delay duration: 0.1 osd debug inject dispatch delay probability: 0.1 osd_max_pg_log_entries: 2 osd_min_pg_log_entries: 1 osd_object_clean_region_max_num_intervals: 1000 osd_pg_log_trim_min: 0 osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd backoff on degraded: true osd backoff on peering: true osd blocked scrub grace period: 3600 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd max scrubs: 1 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd memory target: 1610612736 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - is down - osds down - pg .*? is .*?degraded.*?, acting - pg .*? is stuck - pg degraded - \(POOL_APP_NOT_ENABLED\) sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 min_in: 4 workunit: branch: wip-yuri6-testing-2026-02-22-1629-squid sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 5907 sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri6-testing-2026-02-22-1629-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 targets: trial061.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHHQ+WkraR0IwPZAdjIaSU/Pw/XvOednL/Gi6daK0Dd4YfsvhLcAOQw+2DdNKiGnr2v1spZ0XKgx8JPsWA/jAI4= trial101.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBoIfp7FVbhAEijh+wlebh9rLA+ev88m83ylluZo96gMZlZuRu++KQLXXdiJhRiVtYbbRIvlaTwPlxHTrzOaPqI= tasks: - install: null - ceph: conf: osd: debug monc: 20 - exec: mon.a: - ceph config set mgr mgr/balancer/log_level debug - ceph balancer status - ceph osd set-require-min-compat-client reef - ceph balancer mode read - ceph balancer on - ceph balancer status - ceph balancer status detail - full_sequential: - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-22_19:35:40 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653 2026-02-22T22:13:45.184 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa; will attempt to use it 2026-02-22T22:13:45.185 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa/tasks 2026-02-22T22:13:45.185 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-22T22:13:45.186 INFO:teuthology.task.internal:Checking packages... 2026-02-22T22:13:45.187 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'f90f4eaebb28b619cf76e80cbbe997656da69579' 2026-02-22T22:13:45.187 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-22T22:13:45.187 INFO:teuthology.packaging:ref: None 2026-02-22T22:13:45.187 INFO:teuthology.packaging:tag: None 2026-02-22T22:13:45.187 INFO:teuthology.packaging:branch: wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T22:13:45.187 INFO:teuthology.packaging:sha1: f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T22:13:45.187 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri6-testing-2026-02-22-1629-squid 2026-02-22T22:13:45.302 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-689-gf90f4eae-1jammy 2026-02-22T22:13:45.303 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-22T22:13:45.314 INFO:teuthology.task.internal:no buildpackages task found 2026-02-22T22:13:45.314 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-22T22:13:45.328 INFO:teuthology.task.internal:Saving configuration 2026-02-22T22:13:45.342 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-22T22:13:45.353 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-22T22:13:45.428 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial061.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64197', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-22 22:09:44.319557', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILzyRYXPOyv5YGtac1C5byYJfWD88Qh2VNdF+ihgxp4N'} 2026-02-22T22:13:45.483 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial101.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64197', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-22 22:09:44.320134', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEGSuePwwv9VZMnLdF+f8rBgM1ezibmmjiFcLOB5II2n'} 2026-02-22T22:13:45.483 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-22T22:13:45.494 INFO:teuthology.task.internal:roles: ubuntu@trial061.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2026-02-22T22:13:45.494 INFO:teuthology.task.internal:roles: ubuntu@trial101.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2026-02-22T22:13:45.494 INFO:teuthology.run_tasks:Running task console_log... 2026-02-22T22:13:45.633 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x72b69d9f3920>, signals=[15]) 2026-02-22T22:13:45.633 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-22T22:13:45.644 INFO:teuthology.task.internal:Opening connections... 2026-02-22T22:13:45.644 DEBUG:teuthology.task.internal:connecting to ubuntu@trial061.front.sepia.ceph.com 2026-02-22T22:13:45.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T22:13:45.707 DEBUG:teuthology.task.internal:connecting to ubuntu@trial101.front.sepia.ceph.com 2026-02-22T22:13:45.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T22:13:45.774 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-22T22:13:45.786 DEBUG:teuthology.orchestra.run.trial061:> uname -m 2026-02-22T22:13:45.789 INFO:teuthology.orchestra.run.trial061.stdout:x86_64 2026-02-22T22:13:45.789 DEBUG:teuthology.orchestra.run.trial061:> cat /etc/os-release 2026-02-22T22:13:45.833 INFO:teuthology.orchestra.run.trial061.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-22T22:13:45.833 INFO:teuthology.orchestra.run.trial061.stdout:NAME="Ubuntu" 2026-02-22T22:13:45.833 INFO:teuthology.orchestra.run.trial061.stdout:VERSION_ID="22.04" 2026-02-22T22:13:45.833 INFO:teuthology.orchestra.run.trial061.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-22T22:13:45.833 INFO:teuthology.orchestra.run.trial061.stdout:VERSION_CODENAME=jammy 2026-02-22T22:13:45.833 INFO:teuthology.orchestra.run.trial061.stdout:ID=ubuntu 2026-02-22T22:13:45.833 INFO:teuthology.orchestra.run.trial061.stdout:ID_LIKE=debian 2026-02-22T22:13:45.833 INFO:teuthology.orchestra.run.trial061.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-22T22:13:45.833 INFO:teuthology.orchestra.run.trial061.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-22T22:13:45.833 INFO:teuthology.orchestra.run.trial061.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-22T22:13:45.833 INFO:teuthology.orchestra.run.trial061.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-22T22:13:45.833 INFO:teuthology.orchestra.run.trial061.stdout:UBUNTU_CODENAME=jammy 2026-02-22T22:13:45.834 INFO:teuthology.lock.ops:Updating trial061.front.sepia.ceph.com on lock server 2026-02-22T22:13:45.899 DEBUG:teuthology.orchestra.run.trial101:> uname -m 2026-02-22T22:13:45.903 INFO:teuthology.orchestra.run.trial101.stdout:x86_64 2026-02-22T22:13:45.903 DEBUG:teuthology.orchestra.run.trial101:> cat /etc/os-release 2026-02-22T22:13:45.946 INFO:teuthology.orchestra.run.trial101.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-22T22:13:45.947 INFO:teuthology.orchestra.run.trial101.stdout:NAME="Ubuntu" 2026-02-22T22:13:45.947 INFO:teuthology.orchestra.run.trial101.stdout:VERSION_ID="22.04" 2026-02-22T22:13:45.947 INFO:teuthology.orchestra.run.trial101.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-22T22:13:45.947 INFO:teuthology.orchestra.run.trial101.stdout:VERSION_CODENAME=jammy 2026-02-22T22:13:45.947 INFO:teuthology.orchestra.run.trial101.stdout:ID=ubuntu 2026-02-22T22:13:45.947 INFO:teuthology.orchestra.run.trial101.stdout:ID_LIKE=debian 2026-02-22T22:13:45.947 INFO:teuthology.orchestra.run.trial101.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-22T22:13:45.947 INFO:teuthology.orchestra.run.trial101.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-22T22:13:45.947 INFO:teuthology.orchestra.run.trial101.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-22T22:13:45.947 INFO:teuthology.orchestra.run.trial101.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-22T22:13:45.947 INFO:teuthology.orchestra.run.trial101.stdout:UBUNTU_CODENAME=jammy 2026-02-22T22:13:45.947 INFO:teuthology.lock.ops:Updating trial101.front.sepia.ceph.com on lock server 2026-02-22T22:13:46.012 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-22T22:13:46.025 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-22T22:13:46.036 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-22T22:13:46.036 DEBUG:teuthology.orchestra.run.trial061:> test '!' -e /home/ubuntu/cephtest 2026-02-22T22:13:46.037 DEBUG:teuthology.orchestra.run.trial101:> test '!' -e /home/ubuntu/cephtest 2026-02-22T22:13:46.041 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-22T22:13:46.051 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-22T22:13:46.051 DEBUG:teuthology.orchestra.run.trial061:> test -z $(ls -A /var/lib/ceph) 2026-02-22T22:13:46.083 DEBUG:teuthology.orchestra.run.trial101:> test -z $(ls -A /var/lib/ceph) 2026-02-22T22:13:46.086 INFO:teuthology.orchestra.run.trial061.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-22T22:13:46.088 INFO:teuthology.orchestra.run.trial101.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-22T22:13:46.088 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-22T22:13:46.221 INFO:teuthology.run_tasks:Running task kernel... 2026-02-22T22:13:46.240 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-22T22:13:46.240 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-22T22:13:46.240 DEBUG:teuthology.orchestra.run.trial061:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-22T22:13:46.241 DEBUG:teuthology.orchestra.run.trial101:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-22T22:13:46.244 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:13:46.244 DEBUG:teuthology.orchestra.run.trial061:> uname -r 2026-02-22T22:13:46.244 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:13:46.244 DEBUG:teuthology.orchestra.run.trial101:> uname -r 2026-02-22T22:13:46.289 INFO:teuthology.orchestra.run.trial061.stdout:5.15.0-170-generic 2026-02-22T22:13:46.290 INFO:teuthology.task.kernel:Running kernel on trial061: 5.15.0-170-generic 2026-02-22T22:13:46.290 DEBUG:teuthology.orchestra.run.trial061:> sudo apt-get clean 2026-02-22T22:13:46.290 INFO:teuthology.orchestra.run.trial101.stdout:5.15.0-170-generic 2026-02-22T22:13:46.290 INFO:teuthology.task.kernel:Running kernel on trial101: 5.15.0-170-generic 2026-02-22T22:13:46.290 DEBUG:teuthology.orchestra.run.trial101:> sudo apt-get clean 2026-02-22T22:13:46.348 DEBUG:teuthology.orchestra.run.trial061:> sudo apt-get update 2026-02-22T22:13:46.349 DEBUG:teuthology.orchestra.run.trial101:> sudo apt-get update 2026-02-22T22:13:46.860 INFO:teuthology.orchestra.run.trial101.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-22T22:13:46.862 INFO:teuthology.orchestra.run.trial061.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-22T22:13:46.953 INFO:teuthology.orchestra.run.trial101.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-22T22:13:46.955 INFO:teuthology.orchestra.run.trial061.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-22T22:13:47.304 INFO:teuthology.orchestra.run.trial101.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-22T22:13:47.306 INFO:teuthology.orchestra.run.trial061.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-22T22:13:47.459 INFO:teuthology.orchestra.run.trial101.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-22T22:13:47.460 INFO:teuthology.orchestra.run.trial061.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-22T22:13:47.605 INFO:teuthology.orchestra.run.trial061.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3245 kB] 2026-02-22T22:13:47.605 INFO:teuthology.orchestra.run.trial101.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3245 kB] 2026-02-22T22:13:48.021 INFO:teuthology.orchestra.run.trial101.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [495 kB] 2026-02-22T22:13:48.022 INFO:teuthology.orchestra.run.trial061.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [495 kB] 2026-02-22T22:13:48.035 INFO:teuthology.orchestra.run.trial101.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-22T22:13:48.035 INFO:teuthology.orchestra.run.trial061.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-22T22:13:48.036 INFO:teuthology.orchestra.run.trial101.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1256 kB] 2026-02-22T22:13:48.036 INFO:teuthology.orchestra.run.trial061.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1256 kB] 2026-02-22T22:13:48.071 INFO:teuthology.orchestra.run.trial101.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [314 kB] 2026-02-22T22:13:48.072 INFO:teuthology.orchestra.run.trial061.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [314 kB] 2026-02-22T22:13:48.079 INFO:teuthology.orchestra.run.trial101.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-22T22:13:48.079 INFO:teuthology.orchestra.run.trial061.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-22T22:13:48.080 INFO:teuthology.orchestra.run.trial101.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5310 kB] 2026-02-22T22:13:48.080 INFO:teuthology.orchestra.run.trial061.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5310 kB] 2026-02-22T22:13:48.241 INFO:teuthology.orchestra.run.trial101.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [1005 kB] 2026-02-22T22:13:48.242 INFO:teuthology.orchestra.run.trial061.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [1005 kB] 2026-02-22T22:13:48.265 INFO:teuthology.orchestra.run.trial101.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2983 kB] 2026-02-22T22:13:48.266 INFO:teuthology.orchestra.run.trial061.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2983 kB] 2026-02-22T22:13:48.356 INFO:teuthology.orchestra.run.trial101.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [427 kB] 2026-02-22T22:13:48.357 INFO:teuthology.orchestra.run.trial061.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [427 kB] 2026-02-22T22:13:48.364 INFO:teuthology.orchestra.run.trial061.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-22T22:13:48.364 INFO:teuthology.orchestra.run.trial061.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1018 kB] 2026-02-22T22:13:48.366 INFO:teuthology.orchestra.run.trial101.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-22T22:13:48.367 INFO:teuthology.orchestra.run.trial101.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1018 kB] 2026-02-22T22:13:48.398 INFO:teuthology.orchestra.run.trial061.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.7 kB] 2026-02-22T22:13:48.400 INFO:teuthology.orchestra.run.trial101.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.7 kB] 2026-02-22T22:13:48.400 INFO:teuthology.orchestra.run.trial061.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5147 kB] 2026-02-22T22:13:48.401 INFO:teuthology.orchestra.run.trial101.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5147 kB] 2026-02-22T22:13:48.551 INFO:teuthology.orchestra.run.trial061.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [979 kB] 2026-02-22T22:13:48.556 INFO:teuthology.orchestra.run.trial101.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [979 kB] 2026-02-22T22:13:51.933 INFO:teuthology.orchestra.run.trial061.stdout:Fetched 22.6 MB in 3s (7699 kB/s) 2026-02-22T22:13:52.003 INFO:teuthology.orchestra.run.trial101.stdout:Fetched 22.6 MB in 3s (7597 kB/s) 2026-02-22T22:13:52.454 INFO:teuthology.orchestra.run.trial061.stdout:Reading package lists... 2026-02-22T22:13:52.467 DEBUG:teuthology.orchestra.run.trial061:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-22T22:13:52.500 INFO:teuthology.orchestra.run.trial061.stdout:Reading package lists... 2026-02-22T22:13:52.538 INFO:teuthology.orchestra.run.trial101.stdout:Reading package lists... 2026-02-22T22:13:52.552 DEBUG:teuthology.orchestra.run.trial101:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-22T22:13:52.585 INFO:teuthology.orchestra.run.trial101.stdout:Reading package lists... 2026-02-22T22:13:52.611 INFO:teuthology.orchestra.run.trial061.stdout:Building dependency tree... 2026-02-22T22:13:52.612 INFO:teuthology.orchestra.run.trial061.stdout:Reading state information... 2026-02-22T22:13:52.697 INFO:teuthology.orchestra.run.trial061.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-22T22:13:52.697 INFO:teuthology.orchestra.run.trial061.stdout:linux-image-generic set to manually installed. 2026-02-22T22:13:52.697 INFO:teuthology.orchestra.run.trial061.stdout:The following packages were automatically installed and are no longer required: 2026-02-22T22:13:52.697 INFO:teuthology.orchestra.run.trial061.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-22T22:13:52.697 INFO:teuthology.orchestra.run.trial061.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-22T22:13:52.697 INFO:teuthology.orchestra.run.trial061.stdout: sg3-utils-udev 2026-02-22T22:13:52.698 INFO:teuthology.orchestra.run.trial061.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-22T22:13:52.698 INFO:teuthology.orchestra.run.trial101.stdout:Building dependency tree... 2026-02-22T22:13:52.698 INFO:teuthology.orchestra.run.trial101.stdout:Reading state information... 2026-02-22T22:13:52.716 INFO:teuthology.orchestra.run.trial061.stdout:0 upgraded, 0 newly installed, 0 to remove and 13 not upgraded. 2026-02-22T22:13:52.718 DEBUG:teuthology.orchestra.run.trial061:> dpkg -s linux-image-generic 2026-02-22T22:13:52.768 INFO:teuthology.orchestra.run.trial061.stdout:Package: linux-image-generic 2026-02-22T22:13:52.769 INFO:teuthology.orchestra.run.trial061.stdout:Status: install ok installed 2026-02-22T22:13:52.769 INFO:teuthology.orchestra.run.trial061.stdout:Priority: optional 2026-02-22T22:13:52.769 INFO:teuthology.orchestra.run.trial061.stdout:Section: kernel 2026-02-22T22:13:52.769 INFO:teuthology.orchestra.run.trial061.stdout:Installed-Size: 21 2026-02-22T22:13:52.769 INFO:teuthology.orchestra.run.trial061.stdout:Maintainer: Ubuntu Kernel Team 2026-02-22T22:13:52.769 INFO:teuthology.orchestra.run.trial061.stdout:Architecture: amd64 2026-02-22T22:13:52.769 INFO:teuthology.orchestra.run.trial061.stdout:Source: linux-meta 2026-02-22T22:13:52.769 INFO:teuthology.orchestra.run.trial061.stdout:Version: 5.15.0.170.159 2026-02-22T22:13:52.770 INFO:teuthology.orchestra.run.trial061.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-22T22:13:52.770 INFO:teuthology.orchestra.run.trial061.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-22T22:13:52.770 INFO:teuthology.orchestra.run.trial061.stdout:Recommends: thermald 2026-02-22T22:13:52.770 INFO:teuthology.orchestra.run.trial061.stdout:Description: Generic Linux kernel image 2026-02-22T22:13:52.770 INFO:teuthology.orchestra.run.trial061.stdout: This package will always depend on the latest generic kernel image 2026-02-22T22:13:52.770 INFO:teuthology.orchestra.run.trial061.stdout: available. 2026-02-22T22:13:52.770 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-22T22:13:52.770 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-22T22:13:52.771 DEBUG:teuthology.orchestra.run.trial061:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-22T22:13:52.786 INFO:teuthology.orchestra.run.trial101.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-22T22:13:52.786 INFO:teuthology.orchestra.run.trial101.stdout:linux-image-generic set to manually installed. 2026-02-22T22:13:52.786 INFO:teuthology.orchestra.run.trial101.stdout:The following packages were automatically installed and are no longer required: 2026-02-22T22:13:52.786 INFO:teuthology.orchestra.run.trial101.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-22T22:13:52.786 INFO:teuthology.orchestra.run.trial101.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-22T22:13:52.786 INFO:teuthology.orchestra.run.trial101.stdout: sg3-utils-udev 2026-02-22T22:13:52.786 INFO:teuthology.orchestra.run.trial101.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-22T22:13:52.806 INFO:teuthology.orchestra.run.trial101.stdout:0 upgraded, 0 newly installed, 0 to remove and 13 not upgraded. 2026-02-22T22:13:52.808 DEBUG:teuthology.orchestra.run.trial101:> dpkg -s linux-image-generic 2026-02-22T22:13:52.818 INFO:teuthology.orchestra.run.trial061.stdout:ttyS1 2026-02-22T22:13:52.844 DEBUG:teuthology.parallel:result is None 2026-02-22T22:13:52.857 INFO:teuthology.orchestra.run.trial101.stdout:Package: linux-image-generic 2026-02-22T22:13:52.857 INFO:teuthology.orchestra.run.trial101.stdout:Status: install ok installed 2026-02-22T22:13:52.858 INFO:teuthology.orchestra.run.trial101.stdout:Priority: optional 2026-02-22T22:13:52.858 INFO:teuthology.orchestra.run.trial101.stdout:Section: kernel 2026-02-22T22:13:52.858 INFO:teuthology.orchestra.run.trial101.stdout:Installed-Size: 21 2026-02-22T22:13:52.858 INFO:teuthology.orchestra.run.trial101.stdout:Maintainer: Ubuntu Kernel Team 2026-02-22T22:13:52.858 INFO:teuthology.orchestra.run.trial101.stdout:Architecture: amd64 2026-02-22T22:13:52.858 INFO:teuthology.orchestra.run.trial101.stdout:Source: linux-meta 2026-02-22T22:13:52.858 INFO:teuthology.orchestra.run.trial101.stdout:Version: 5.15.0.170.159 2026-02-22T22:13:52.858 INFO:teuthology.orchestra.run.trial101.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-22T22:13:52.858 INFO:teuthology.orchestra.run.trial101.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-22T22:13:52.858 INFO:teuthology.orchestra.run.trial101.stdout:Recommends: thermald 2026-02-22T22:13:52.858 INFO:teuthology.orchestra.run.trial101.stdout:Description: Generic Linux kernel image 2026-02-22T22:13:52.859 INFO:teuthology.orchestra.run.trial101.stdout: This package will always depend on the latest generic kernel image 2026-02-22T22:13:52.859 INFO:teuthology.orchestra.run.trial101.stdout: available. 2026-02-22T22:13:52.859 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-22T22:13:52.859 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-22T22:13:52.859 DEBUG:teuthology.orchestra.run.trial101:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-22T22:13:52.908 INFO:teuthology.orchestra.run.trial101.stdout:ttyS1 2026-02-22T22:13:52.926 DEBUG:teuthology.parallel:result is None 2026-02-22T22:13:52.926 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-22T22:13:52.939 INFO:teuthology.task.internal:Creating test directory... 2026-02-22T22:13:52.939 DEBUG:teuthology.orchestra.run.trial061:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-22T22:13:52.941 DEBUG:teuthology.orchestra.run.trial101:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-22T22:13:52.971 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-22T22:13:52.981 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-22T22:13:52.988 INFO:teuthology.task.internal:Creating archive directory... 2026-02-22T22:13:52.989 DEBUG:teuthology.orchestra.run.trial061:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-22T22:13:52.991 DEBUG:teuthology.orchestra.run.trial101:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-22T22:13:53.024 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-22T22:13:53.035 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-22T22:13:53.036 DEBUG:teuthology.orchestra.run.trial061:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-22T22:13:53.040 DEBUG:teuthology.orchestra.run.trial101:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-22T22:13:53.047 INFO:teuthology.orchestra.run.trial061.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T22:13:53.053 INFO:teuthology.orchestra.run.trial061.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T22:13:53.068 INFO:teuthology.orchestra.run.trial101.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T22:13:53.074 INFO:teuthology.orchestra.run.trial101.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-22T22:13:53.076 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-22T22:13:53.088 INFO:teuthology.task.internal:Configuring sudo... 2026-02-22T22:13:53.088 DEBUG:teuthology.orchestra.run.trial061:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-22T22:13:53.100 DEBUG:teuthology.orchestra.run.trial101:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-22T22:13:53.128 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-22T22:13:53.144 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-22T22:13:53.145 DEBUG:teuthology.orchestra.run.trial061:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-22T22:13:53.152 DEBUG:teuthology.orchestra.run.trial101:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-22T22:13:53.175 DEBUG:teuthology.orchestra.run.trial061:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T22:13:53.198 DEBUG:teuthology.orchestra.run.trial061:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T22:13:53.242 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T22:13:53.242 DEBUG:teuthology.orchestra.run.trial061:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-22T22:13:53.290 DEBUG:teuthology.orchestra.run.trial101:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T22:13:53.295 DEBUG:teuthology.orchestra.run.trial101:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T22:13:53.339 DEBUG:teuthology.orchestra.run.trial101:> set -ex 2026-02-22T22:13:53.340 DEBUG:teuthology.orchestra.run.trial101:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-22T22:13:53.388 DEBUG:teuthology.orchestra.run.trial061:> sudo service rsyslog restart 2026-02-22T22:13:53.389 DEBUG:teuthology.orchestra.run.trial101:> sudo service rsyslog restart 2026-02-22T22:13:53.449 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-22T22:13:53.462 INFO:teuthology.task.internal:Starting timer... 2026-02-22T22:13:53.463 INFO:teuthology.run_tasks:Running task pcp... 2026-02-22T22:13:53.484 INFO:teuthology.run_tasks:Running task selinux... 2026-02-22T22:13:53.502 DEBUG:teuthology.task.selinux:Excluding trial061: OS 'ubuntu' does not support SELinux 2026-02-22T22:13:53.502 DEBUG:teuthology.task.selinux:Excluding trial101: OS 'ubuntu' does not support SELinux 2026-02-22T22:13:53.502 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-22T22:13:53.502 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-22T22:13:53.502 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-22T22:13:53.503 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-22T22:13:53.518 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-22T22:13:53.520 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-22T22:13:53.627 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-22T22:13:53.639 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-22T22:13:53.640 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial061.front.sepia.ceph.com,trial101.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-22T22:16:18.607 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial061.front.sepia.ceph.com'), Remote(name='ubuntu@trial101.front.sepia.ceph.com')] 2026-02-22T22:16:18.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial061.front.sepia.ceph.com' 2026-02-22T22:16:18.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T22:16:18.719 DEBUG:teuthology.orchestra.run.trial061:> true 2026-02-22T22:16:18.969 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial061.front.sepia.ceph.com' 2026-02-22T22:16:18.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial101.front.sepia.ceph.com' 2026-02-22T22:16:18.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-22T22:16:19.080 DEBUG:teuthology.orchestra.run.trial101:> true 2026-02-22T22:16:19.328 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial101.front.sepia.ceph.com' 2026-02-22T22:16:19.328 INFO:teuthology.run_tasks:Running task clock... 2026-02-22T22:16:19.344 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-22T22:16:19.344 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-22T22:16:19.344 DEBUG:teuthology.orchestra.run.trial061:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T22:16:19.346 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-22T22:16:19.346 DEBUG:teuthology.orchestra.run.trial101:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T22:16:19.364 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 22:16:19 ntpd[9421]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-22T22:16:19.364 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 22:16:19 ntpd[9421]: Command line: ntpd -gq 2026-02-22T22:16:19.364 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 22:16:19 ntpd[9421]: ---------------------------------------------------- 2026-02-22T22:16:19.364 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 22:16:19 ntpd[9421]: ntp-4 is maintained by Network Time Foundation, 2026-02-22T22:16:19.364 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 22:16:19 ntpd[9421]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-22T22:16:19.364 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 22:16:19 ntpd[9421]: corporation. Support and training for ntp-4 are 2026-02-22T22:16:19.364 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 22:16:19 ntpd[9421]: available at https://www.nwtime.org/support 2026-02-22T22:16:19.365 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 22:16:19 ntpd[9421]: ---------------------------------------------------- 2026-02-22T22:16:19.365 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 22:16:19 ntpd[9421]: proto: precision = 0.020 usec (-25) 2026-02-22T22:16:19.366 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 22:16:19 ntpd[9421]: basedate set to 2022-02-04 2026-02-22T22:16:19.366 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 22:16:19 ntpd[9421]: gps base set to 2022-02-06 (week 2196) 2026-02-22T22:16:19.366 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 22:16:19 ntpd[9421]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-22T22:16:19.366 INFO:teuthology.orchestra.run.trial061.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-22T22:16:19.366 INFO:teuthology.orchestra.run.trial061.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-22T22:16:19.367 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 22:16:19 ntpd[9421]: restrict ::: KOD does nothing without LIMITED. 2026-02-22T22:16:19.367 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 22:16:19 ntpd[9421]: Listen and drop on 0 v6wildcard [::]:123 2026-02-22T22:16:19.368 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 22:16:19 ntpd[9421]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-22T22:16:19.368 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 22:16:19 ntpd[9421]: Listen normally on 2 lo 127.0.0.1:123 2026-02-22T22:16:19.368 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 22:16:19 ntpd[9421]: Listen normally on 3 enp1s0f0 10.20.193.61:123 2026-02-22T22:16:19.368 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 22:16:19 ntpd[9421]: Listen normally on 4 lo [::1]:123 2026-02-22T22:16:19.368 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 22:16:19 ntpd[9421]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:6268%2]:123 2026-02-22T22:16:19.368 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 22:16:19 ntpd[9421]: Listening on routing socket on fd #22 for interface updates 2026-02-22T22:16:19.389 INFO:teuthology.orchestra.run.trial101.stdout:22 Feb 22:16:19 ntpd[9421]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-22T22:16:19.389 INFO:teuthology.orchestra.run.trial101.stdout:22 Feb 22:16:19 ntpd[9421]: Command line: ntpd -gq 2026-02-22T22:16:19.390 INFO:teuthology.orchestra.run.trial101.stdout:22 Feb 22:16:19 ntpd[9421]: ---------------------------------------------------- 2026-02-22T22:16:19.390 INFO:teuthology.orchestra.run.trial101.stdout:22 Feb 22:16:19 ntpd[9421]: ntp-4 is maintained by Network Time Foundation, 2026-02-22T22:16:19.390 INFO:teuthology.orchestra.run.trial101.stdout:22 Feb 22:16:19 ntpd[9421]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-22T22:16:19.390 INFO:teuthology.orchestra.run.trial101.stdout:22 Feb 22:16:19 ntpd[9421]: corporation. Support and training for ntp-4 are 2026-02-22T22:16:19.390 INFO:teuthology.orchestra.run.trial101.stdout:22 Feb 22:16:19 ntpd[9421]: available at https://www.nwtime.org/support 2026-02-22T22:16:19.390 INFO:teuthology.orchestra.run.trial101.stdout:22 Feb 22:16:19 ntpd[9421]: ---------------------------------------------------- 2026-02-22T22:16:19.390 INFO:teuthology.orchestra.run.trial101.stdout:22 Feb 22:16:19 ntpd[9421]: proto: precision = 0.020 usec (-25) 2026-02-22T22:16:19.390 INFO:teuthology.orchestra.run.trial101.stdout:22 Feb 22:16:19 ntpd[9421]: basedate set to 2022-02-04 2026-02-22T22:16:19.390 INFO:teuthology.orchestra.run.trial101.stdout:22 Feb 22:16:19 ntpd[9421]: gps base set to 2022-02-06 (week 2196) 2026-02-22T22:16:19.391 INFO:teuthology.orchestra.run.trial101.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-22T22:16:19.391 INFO:teuthology.orchestra.run.trial101.stdout:22 Feb 22:16:19 ntpd[9421]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-22T22:16:19.391 INFO:teuthology.orchestra.run.trial101.stdout:22 Feb 22:16:19 ntpd[9421]: restrict ::: KOD does nothing without LIMITED. 2026-02-22T22:16:19.392 INFO:teuthology.orchestra.run.trial101.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-22T22:16:19.393 INFO:teuthology.orchestra.run.trial101.stdout:22 Feb 22:16:19 ntpd[9421]: Listen and drop on 0 v6wildcard [::]:123 2026-02-22T22:16:19.393 INFO:teuthology.orchestra.run.trial101.stdout:22 Feb 22:16:19 ntpd[9421]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-22T22:16:19.393 INFO:teuthology.orchestra.run.trial101.stdout:22 Feb 22:16:19 ntpd[9421]: Listen normally on 2 lo 127.0.0.1:123 2026-02-22T22:16:19.393 INFO:teuthology.orchestra.run.trial101.stdout:22 Feb 22:16:19 ntpd[9421]: Listen normally on 3 enp1s0f0 10.20.193.101:123 2026-02-22T22:16:19.393 INFO:teuthology.orchestra.run.trial101.stdout:22 Feb 22:16:19 ntpd[9421]: Listen normally on 4 lo [::1]:123 2026-02-22T22:16:19.393 INFO:teuthology.orchestra.run.trial101.stdout:22 Feb 22:16:19 ntpd[9421]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:6366%2]:123 2026-02-22T22:16:19.393 INFO:teuthology.orchestra.run.trial101.stdout:22 Feb 22:16:19 ntpd[9421]: Listening on routing socket on fd #22 for interface updates 2026-02-22T22:16:20.365 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:20 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:20.365 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:20 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:20.426 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:20 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:20.427 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:20 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:20.427 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:20 ntpd[9421]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:16:20.427 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:20 ntpd[9421]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:16:21.364 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:21 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:21.365 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:21 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:21.434 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:21 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:21.435 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:21 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:21.435 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:21 ntpd[9421]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:16:21.435 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:21 ntpd[9421]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:16:22.365 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:22 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:22.365 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:22 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:22.365 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:22 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:22.365 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:22 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:22.426 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:22 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:22.426 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:22 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:22.426 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:22 ntpd[9421]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:16:22.426 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:22 ntpd[9421]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:16:22.429 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:22 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:22.429 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:22 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:22.429 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:22 ntpd[9421]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:16:22.429 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:22 ntpd[9421]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:16:23.364 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:23 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:23.365 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:23 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:23.389 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:23 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:23.390 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:23 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:23.390 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:23 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:23.390 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:23 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:23.434 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:23 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:23.434 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:23 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:23.434 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:23 ntpd[9421]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:16:23.434 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:23 ntpd[9421]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:16:23.456 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:23 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:23.456 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:23 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:23.456 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:23 ntpd[9421]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:16:23.456 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:23 ntpd[9421]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:16:23.459 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:23 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:23.459 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:23 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:23.459 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:23 ntpd[9421]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:16:23.459 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:23 ntpd[9421]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:16:24.365 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:24 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:24.365 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:24 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:24.365 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:24 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:24.365 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:24 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:24.365 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:24 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:24.365 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:24 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:24.389 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:24 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:24.389 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:24 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:24.389 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:24 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:24.389 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:24 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:24.427 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:24 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:24.427 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:24 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:24.427 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:24 ntpd[9421]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:16:24.428 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:24 ntpd[9421]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:16:24.429 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:24 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:24.430 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:24 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:24.430 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:24 ntpd[9421]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:16:24.430 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:24 ntpd[9421]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:16:24.437 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:24 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:24.437 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:24 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:24.437 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:24 ntpd[9421]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:16:24.437 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:24 ntpd[9421]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:16:24.452 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:24 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:24.452 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:24 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:24.452 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:24 ntpd[9421]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:16:24.452 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:24 ntpd[9421]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:16:24.463 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:24 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:24.463 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:24 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:24.463 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:24 ntpd[9421]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:16:24.463 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:24 ntpd[9421]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:16:25.364 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:25 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:25.365 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:25 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:25.389 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:25 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:25.389 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:25 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:25.389 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:25 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:25.390 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:25 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:25.433 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:25 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:25.433 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:25 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:25.433 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:25 ntpd[9421]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:16:25.433 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:25 ntpd[9421]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:16:25.455 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:25 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:25.455 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:25 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:25.455 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:25 ntpd[9421]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:16:25.455 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:25 ntpd[9421]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:16:25.458 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:25 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:25.458 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:25 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:25.458 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:25 ntpd[9421]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:16:25.458 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:25 ntpd[9421]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:16:26.365 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:26 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:26.365 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:26 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:26.365 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:26 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:26.365 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:26 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:26.366 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:26 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:26.366 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:26 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:26.389 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:26 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:26.390 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:26 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:26.390 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:26 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:26.390 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:26 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:26.426 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:26 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:26.427 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:26 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:26.427 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:26 ntpd[9421]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:16:26.427 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:26 ntpd[9421]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:16:26.427 INFO:teuthology.orchestra.run.trial061.stdout:22 Feb 22:16:26 ntpd[9421]: ntpd: time set +0.235422 s 2026-02-22T22:16:26.427 INFO:teuthology.orchestra.run.trial061.stdout:ntpd: time set +0.235422s 2026-02-22T22:16:26.428 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:26 ntpd[9421]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-22T22:16:26.428 INFO:teuthology.orchestra.run.trial061.stderr:22 Feb 22:16:26 ntpd[9421]: can't open /var/log/ntpstats/loopstats.20260222: Permission denied 2026-02-22T22:16:26.451 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:26 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:26.452 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:26 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:26.452 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:26 ntpd[9421]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:16:26.452 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:26 ntpd[9421]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:16:26.461 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:26 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:26.461 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:26 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:26.462 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:26 ntpd[9421]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:16:26.462 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:26 ntpd[9421]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:16:26.490 INFO:teuthology.orchestra.run.trial061.stdout: remote refid st t when poll reach delay offset jitter 2026-02-22T22:16:26.490 INFO:teuthology.orchestra.run.trial061.stdout:============================================================================== 2026-02-22T22:16:26.490 INFO:teuthology.orchestra.run.trial061.stdout: rn-03.koehn.com .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-22T22:16:26.490 INFO:teuthology.orchestra.run.trial061.stdout: 23-93-251-54.de .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-22T22:16:26.490 INFO:teuthology.orchestra.run.trial061.stdout: 198.137.202.32 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-22T22:16:26.490 INFO:teuthology.orchestra.run.trial061.stdout: dns-e.ns4v.icu .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-22T22:16:27.389 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:27 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:27.389 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:27 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:27.389 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:27 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:27.389 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:27 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:27.455 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:27 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:27.455 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:27 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:27.455 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:27 ntpd[9421]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:16:27.455 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:27 ntpd[9421]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:16:27.458 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:27 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:27.458 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:27 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:27.458 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:27 ntpd[9421]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:16:27.458 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:27 ntpd[9421]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:16:28.389 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:28 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:28.389 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:28 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:28.389 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:28 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:28.390 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:28 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:28.452 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:28 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:28.452 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:28 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:28.452 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:28 ntpd[9421]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:16:28.452 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:28 ntpd[9421]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:16:28.461 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:28 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:28.461 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:28 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:28.461 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:28 ntpd[9421]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:16:28.461 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:28 ntpd[9421]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:16:29.389 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:29 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:29.389 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:29 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:29.390 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:29 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:29.390 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:29 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:29.456 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:29 ntpd[9421]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-22T22:16:29.456 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:29 ntpd[9421]: can't open /var/log/ntpstats/rawstats.20260222: Permission denied 2026-02-22T22:16:29.456 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:29 ntpd[9421]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-22T22:16:29.456 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:29 ntpd[9421]: can't open /var/log/ntpstats/peerstats.20260222: Permission denied 2026-02-22T22:16:29.457 INFO:teuthology.orchestra.run.trial101.stdout:22 Feb 22:16:29 ntpd[9421]: ntpd: time slew -0.003097 s 2026-02-22T22:16:29.457 INFO:teuthology.orchestra.run.trial101.stdout:ntpd: time slew -0.003097s 2026-02-22T22:16:29.457 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:29 ntpd[9421]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-22T22:16:29.458 INFO:teuthology.orchestra.run.trial101.stderr:22 Feb 22:16:29 ntpd[9421]: can't open /var/log/ntpstats/loopstats.20260222: Permission denied 2026-02-22T22:16:29.495 INFO:teuthology.orchestra.run.trial101.stdout: remote refid st t when poll reach delay offset jitter 2026-02-22T22:16:29.495 INFO:teuthology.orchestra.run.trial101.stdout:============================================================================== 2026-02-22T22:16:29.496 INFO:teuthology.orchestra.run.trial101.stdout: rn-03.koehn.com .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-22T22:16:29.496 INFO:teuthology.orchestra.run.trial101.stdout: 23.186.168.130 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-22T22:16:29.496 INFO:teuthology.orchestra.run.trial101.stdout: 198.137.202.32 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-22T22:16:29.496 INFO:teuthology.orchestra.run.trial101.stdout: chi2.us.ntp.li .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-22T22:16:29.497 INFO:teuthology.run_tasks:Running task install... 2026-02-22T22:16:29.518 DEBUG:teuthology.task.install:project ceph 2026-02-22T22:16:29.518 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}} 2026-02-22T22:16:29.518 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'} 2026-02-22T22:16:29.518 INFO:teuthology.task.install:Using flavor: default 2026-02-22T22:16:29.521 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-22T22:16:29.521 INFO:teuthology.task.install:extra packages: [] 2026-02-22T22:16:29.521 DEBUG:teuthology.orchestra.run.trial061:> sudo apt-key list | grep Ceph 2026-02-22T22:16:29.521 DEBUG:teuthology.orchestra.run.trial101:> sudo apt-key list | grep Ceph 2026-02-22T22:16:29.574 INFO:teuthology.orchestra.run.trial061.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-22T22:16:29.593 INFO:teuthology.orchestra.run.trial101.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-22T22:16:29.604 INFO:teuthology.orchestra.run.trial061.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-22T22:16:29.604 INFO:teuthology.orchestra.run.trial061.stdout:uid [ unknown] Ceph.com (release key) 2026-02-22T22:16:29.606 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-22T22:16:29.606 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T22:16:29.623 INFO:teuthology.orchestra.run.trial101.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-22T22:16:29.623 INFO:teuthology.orchestra.run.trial101.stdout:uid [ unknown] Ceph.com (release key) 2026-02-22T22:16:29.625 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-22T22:16:29.625 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T22:16:29.806 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default/ 2026-02-22T22:16:29.806 INFO:teuthology.task.install.deb:Package version is 19.2.3-689-gf90f4eae-1jammy 2026-02-22T22:16:29.815 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default/ 2026-02-22T22:16:29.815 INFO:teuthology.task.install.deb:Package version is 19.2.3-689-gf90f4eae-1jammy 2026-02-22T22:16:29.964 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T22:16:29.964 DEBUG:teuthology.orchestra.run.trial061:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-22T22:16:29.972 DEBUG:teuthology.orchestra.run.trial101:> set -ex 2026-02-22T22:16:29.972 DEBUG:teuthology.orchestra.run.trial101:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-22T22:16:29.975 DEBUG:teuthology.orchestra.run.trial061:> sudo apt-get update 2026-02-22T22:16:29.981 DEBUG:teuthology.orchestra.run.trial101:> sudo apt-get update 2026-02-22T22:16:30.134 INFO:teuthology.orchestra.run.trial101.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy InRelease 2026-02-22T22:16:30.134 INFO:teuthology.orchestra.run.trial061.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy InRelease 2026-02-22T22:16:30.146 INFO:teuthology.orchestra.run.trial061.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy Release [7662 B] 2026-02-22T22:16:30.146 INFO:teuthology.orchestra.run.trial101.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy Release [7662 B] 2026-02-22T22:16:30.157 INFO:teuthology.orchestra.run.trial101.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-22T22:16:30.158 INFO:teuthology.orchestra.run.trial061.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-22T22:16:30.169 INFO:teuthology.orchestra.run.trial101.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2026-02-22T22:16:30.173 INFO:teuthology.orchestra.run.trial061.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-22T22:16:30.173 INFO:teuthology.orchestra.run.trial061.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2026-02-22T22:16:30.176 INFO:teuthology.orchestra.run.trial101.stdout:Hit:5 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-22T22:16:30.178 INFO:teuthology.orchestra.run.trial061.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-22T22:16:30.185 INFO:teuthology.orchestra.run.trial101.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-22T22:16:30.187 INFO:teuthology.orchestra.run.trial061.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-22T22:16:30.190 INFO:teuthology.orchestra.run.trial101.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-22T22:16:30.197 INFO:teuthology.orchestra.run.trial061.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-22T22:16:30.200 INFO:teuthology.orchestra.run.trial101.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-22T22:16:30.508 INFO:teuthology.orchestra.run.trial101.stdout:Fetched 25.8 kB in 0s (70.1 kB/s) 2026-02-22T22:16:30.510 INFO:teuthology.orchestra.run.trial061.stdout:Fetched 25.8 kB in 0s (68.4 kB/s) 2026-02-22T22:16:31.026 INFO:teuthology.orchestra.run.trial101.stdout:Reading package lists... 2026-02-22T22:16:31.034 INFO:teuthology.orchestra.run.trial061.stdout:Reading package lists... 2026-02-22T22:16:31.038 DEBUG:teuthology.orchestra.run.trial101:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.2.3-689-gf90f4eae-1jammy cephadm=19.2.3-689-gf90f4eae-1jammy ceph-mds=19.2.3-689-gf90f4eae-1jammy ceph-mgr=19.2.3-689-gf90f4eae-1jammy ceph-common=19.2.3-689-gf90f4eae-1jammy ceph-fuse=19.2.3-689-gf90f4eae-1jammy ceph-test=19.2.3-689-gf90f4eae-1jammy ceph-volume=19.2.3-689-gf90f4eae-1jammy radosgw=19.2.3-689-gf90f4eae-1jammy python3-rados=19.2.3-689-gf90f4eae-1jammy python3-rgw=19.2.3-689-gf90f4eae-1jammy python3-cephfs=19.2.3-689-gf90f4eae-1jammy python3-rbd=19.2.3-689-gf90f4eae-1jammy libcephfs2=19.2.3-689-gf90f4eae-1jammy libcephfs-dev=19.2.3-689-gf90f4eae-1jammy librados2=19.2.3-689-gf90f4eae-1jammy librbd1=19.2.3-689-gf90f4eae-1jammy rbd-fuse=19.2.3-689-gf90f4eae-1jammy 2026-02-22T22:16:31.047 DEBUG:teuthology.orchestra.run.trial061:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.2.3-689-gf90f4eae-1jammy cephadm=19.2.3-689-gf90f4eae-1jammy ceph-mds=19.2.3-689-gf90f4eae-1jammy ceph-mgr=19.2.3-689-gf90f4eae-1jammy ceph-common=19.2.3-689-gf90f4eae-1jammy ceph-fuse=19.2.3-689-gf90f4eae-1jammy ceph-test=19.2.3-689-gf90f4eae-1jammy ceph-volume=19.2.3-689-gf90f4eae-1jammy radosgw=19.2.3-689-gf90f4eae-1jammy python3-rados=19.2.3-689-gf90f4eae-1jammy python3-rgw=19.2.3-689-gf90f4eae-1jammy python3-cephfs=19.2.3-689-gf90f4eae-1jammy python3-rbd=19.2.3-689-gf90f4eae-1jammy libcephfs2=19.2.3-689-gf90f4eae-1jammy libcephfs-dev=19.2.3-689-gf90f4eae-1jammy librados2=19.2.3-689-gf90f4eae-1jammy librbd1=19.2.3-689-gf90f4eae-1jammy rbd-fuse=19.2.3-689-gf90f4eae-1jammy 2026-02-22T22:16:31.071 INFO:teuthology.orchestra.run.trial101.stdout:Reading package lists... 2026-02-22T22:16:31.081 INFO:teuthology.orchestra.run.trial061.stdout:Reading package lists... 2026-02-22T22:16:31.177 INFO:teuthology.orchestra.run.trial101.stdout:Building dependency tree... 2026-02-22T22:16:31.178 INFO:teuthology.orchestra.run.trial101.stdout:Reading state information... 2026-02-22T22:16:31.194 INFO:teuthology.orchestra.run.trial061.stdout:Building dependency tree... 2026-02-22T22:16:31.194 INFO:teuthology.orchestra.run.trial061.stdout:Reading state information... 2026-02-22T22:16:31.266 INFO:teuthology.orchestra.run.trial101.stdout:The following packages were automatically installed and are no longer required: 2026-02-22T22:16:31.267 INFO:teuthology.orchestra.run.trial101.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-22T22:16:31.267 INFO:teuthology.orchestra.run.trial101.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-22T22:16:31.267 INFO:teuthology.orchestra.run.trial101.stdout: sg3-utils-udev 2026-02-22T22:16:31.267 INFO:teuthology.orchestra.run.trial101.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-22T22:16:31.267 INFO:teuthology.orchestra.run.trial101.stdout:The following additional packages will be installed: 2026-02-22T22:16:31.267 INFO:teuthology.orchestra.run.trial101.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-22T22:16:31.268 INFO:teuthology.orchestra.run.trial101.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2026-02-22T22:16:31.268 INFO:teuthology.orchestra.run.trial101.stdout: libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 2026-02-22T22:16:31.268 INFO:teuthology.orchestra.run.trial101.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-22T22:16:31.268 INFO:teuthology.orchestra.run.trial101.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2026-02-22T22:16:31.268 INFO:teuthology.orchestra.run.trial101.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2026-02-22T22:16:31.268 INFO:teuthology.orchestra.run.trial101.stdout: pkg-config python-asyncssh-doc python-pastedeploy-tpl python3-asyncssh 2026-02-22T22:16:31.268 INFO:teuthology.orchestra.run.trial101.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cheroot 2026-02-22T22:16:31.268 INFO:teuthology.orchestra.run.trial101.stdout: python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-22T22:16:31.268 INFO:teuthology.orchestra.run.trial101.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-22T22:16:31.269 INFO:teuthology.orchestra.run.trial101.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-logutils 2026-02-22T22:16:31.269 INFO:teuthology.orchestra.run.trial101.stdout: python3-mako python3-natsort python3-paste python3-pastedeploy 2026-02-22T22:16:31.269 INFO:teuthology.orchestra.run.trial101.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2026-02-22T22:16:31.269 INFO:teuthology.orchestra.run.trial101.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-22T22:16:31.269 INFO:teuthology.orchestra.run.trial101.stdout: python3-pyinotify python3-pytest python3-repoze.lru 2026-02-22T22:16:31.269 INFO:teuthology.orchestra.run.trial101.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2026-02-22T22:16:31.269 INFO:teuthology.orchestra.run.trial101.stdout: python3-simplejson python3-singledispatch python3-sklearn 2026-02-22T22:16:31.269 INFO:teuthology.orchestra.run.trial101.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2026-02-22T22:16:31.270 INFO:teuthology.orchestra.run.trial101.stdout: python3-toml python3-waitress python3-wcwidth python3-webob 2026-02-22T22:16:31.270 INFO:teuthology.orchestra.run.trial101.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2026-02-22T22:16:31.270 INFO:teuthology.orchestra.run.trial101.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2026-02-22T22:16:31.270 INFO:teuthology.orchestra.run.trial101.stdout:Suggested packages: 2026-02-22T22:16:31.270 INFO:teuthology.orchestra.run.trial101.stdout: python3-influxdb readline-doc python3-beaker python-mako-doc 2026-02-22T22:16:31.270 INFO:teuthology.orchestra.run.trial101.stdout: python-natsort-doc httpd-wsgi libapache2-mod-python libapache2-mod-scgi 2026-02-22T22:16:31.270 INFO:teuthology.orchestra.run.trial101.stdout: libjs-mochikit python-pecan-doc python-psutil-doc subversion 2026-02-22T22:16:31.270 INFO:teuthology.orchestra.run.trial101.stdout: python-pygments-doc ttf-bitstream-vera python-pyinotify-doc python3-dap 2026-02-22T22:16:31.270 INFO:teuthology.orchestra.run.trial101.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2026-02-22T22:16:31.271 INFO:teuthology.orchestra.run.trial101.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2026-02-22T22:16:31.271 INFO:teuthology.orchestra.run.trial101.stdout:Recommended packages: 2026-02-22T22:16:31.271 INFO:teuthology.orchestra.run.trial101.stdout: btrfs-tools 2026-02-22T22:16:31.287 INFO:teuthology.orchestra.run.trial061.stdout:The following packages were automatically installed and are no longer required: 2026-02-22T22:16:31.288 INFO:teuthology.orchestra.run.trial061.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-22T22:16:31.288 INFO:teuthology.orchestra.run.trial061.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-22T22:16:31.288 INFO:teuthology.orchestra.run.trial061.stdout: sg3-utils-udev 2026-02-22T22:16:31.288 INFO:teuthology.orchestra.run.trial061.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-22T22:16:31.288 INFO:teuthology.orchestra.run.trial061.stdout:The following additional packages will be installed: 2026-02-22T22:16:31.288 INFO:teuthology.orchestra.run.trial061.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-22T22:16:31.288 INFO:teuthology.orchestra.run.trial061.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2026-02-22T22:16:31.288 INFO:teuthology.orchestra.run.trial061.stdout: libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 2026-02-22T22:16:31.288 INFO:teuthology.orchestra.run.trial061.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-22T22:16:31.288 INFO:teuthology.orchestra.run.trial061.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2026-02-22T22:16:31.288 INFO:teuthology.orchestra.run.trial061.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2026-02-22T22:16:31.288 INFO:teuthology.orchestra.run.trial061.stdout: pkg-config python-asyncssh-doc python-pastedeploy-tpl python3-asyncssh 2026-02-22T22:16:31.288 INFO:teuthology.orchestra.run.trial061.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cheroot 2026-02-22T22:16:31.288 INFO:teuthology.orchestra.run.trial061.stdout: python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-22T22:16:31.288 INFO:teuthology.orchestra.run.trial061.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-22T22:16:31.289 INFO:teuthology.orchestra.run.trial061.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-logutils 2026-02-22T22:16:31.289 INFO:teuthology.orchestra.run.trial061.stdout: python3-mako python3-natsort python3-paste python3-pastedeploy 2026-02-22T22:16:31.289 INFO:teuthology.orchestra.run.trial061.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2026-02-22T22:16:31.289 INFO:teuthology.orchestra.run.trial061.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-22T22:16:31.289 INFO:teuthology.orchestra.run.trial061.stdout: python3-pyinotify python3-pytest python3-repoze.lru 2026-02-22T22:16:31.289 INFO:teuthology.orchestra.run.trial061.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2026-02-22T22:16:31.289 INFO:teuthology.orchestra.run.trial061.stdout: python3-simplejson python3-singledispatch python3-sklearn 2026-02-22T22:16:31.289 INFO:teuthology.orchestra.run.trial061.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2026-02-22T22:16:31.289 INFO:teuthology.orchestra.run.trial061.stdout: python3-toml python3-waitress python3-wcwidth python3-webob 2026-02-22T22:16:31.289 INFO:teuthology.orchestra.run.trial061.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2026-02-22T22:16:31.289 INFO:teuthology.orchestra.run.trial061.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2026-02-22T22:16:31.289 INFO:teuthology.orchestra.run.trial061.stdout:Suggested packages: 2026-02-22T22:16:31.289 INFO:teuthology.orchestra.run.trial061.stdout: python3-influxdb readline-doc python3-beaker python-mako-doc 2026-02-22T22:16:31.289 INFO:teuthology.orchestra.run.trial061.stdout: python-natsort-doc httpd-wsgi libapache2-mod-python libapache2-mod-scgi 2026-02-22T22:16:31.289 INFO:teuthology.orchestra.run.trial061.stdout: libjs-mochikit python-pecan-doc python-psutil-doc subversion 2026-02-22T22:16:31.289 INFO:teuthology.orchestra.run.trial061.stdout: python-pygments-doc ttf-bitstream-vera python-pyinotify-doc python3-dap 2026-02-22T22:16:31.290 INFO:teuthology.orchestra.run.trial061.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2026-02-22T22:16:31.290 INFO:teuthology.orchestra.run.trial061.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2026-02-22T22:16:31.290 INFO:teuthology.orchestra.run.trial061.stdout:Recommended packages: 2026-02-22T22:16:31.290 INFO:teuthology.orchestra.run.trial061.stdout: btrfs-tools 2026-02-22T22:16:31.300 INFO:teuthology.orchestra.run.trial101.stdout:The following NEW packages will be installed: 2026-02-22T22:16:31.300 INFO:teuthology.orchestra.run.trial101.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-22T22:16:31.300 INFO:teuthology.orchestra.run.trial101.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-22T22:16:31.300 INFO:teuthology.orchestra.run.trial101.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2026-02-22T22:16:31.300 INFO:teuthology.orchestra.run.trial101.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 2026-02-22T22:16:31.300 INFO:teuthology.orchestra.run.trial101.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2026-02-22T22:16:31.300 INFO:teuthology.orchestra.run.trial101.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2026-02-22T22:16:31.301 INFO:teuthology.orchestra.run.trial101.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2026-02-22T22:16:31.301 INFO:teuthology.orchestra.run.trial101.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2026-02-22T22:16:31.301 INFO:teuthology.orchestra.run.trial101.stdout: python-pastedeploy-tpl python3-asyncssh python3-cachetools 2026-02-22T22:16:31.301 INFO:teuthology.orchestra.run.trial101.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cheroot 2026-02-22T22:16:31.302 INFO:teuthology.orchestra.run.trial101.stdout: python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-22T22:16:31.302 INFO:teuthology.orchestra.run.trial101.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-22T22:16:31.302 INFO:teuthology.orchestra.run.trial101.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-logutils 2026-02-22T22:16:31.302 INFO:teuthology.orchestra.run.trial101.stdout: python3-mako python3-natsort python3-paste python3-pastedeploy 2026-02-22T22:16:31.302 INFO:teuthology.orchestra.run.trial101.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2026-02-22T22:16:31.302 INFO:teuthology.orchestra.run.trial101.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-22T22:16:31.302 INFO:teuthology.orchestra.run.trial101.stdout: python3-pyinotify python3-pytest python3-rados python3-rbd 2026-02-22T22:16:31.302 INFO:teuthology.orchestra.run.trial101.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2026-02-22T22:16:31.302 INFO:teuthology.orchestra.run.trial101.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2026-02-22T22:16:31.302 INFO:teuthology.orchestra.run.trial101.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2026-02-22T22:16:31.302 INFO:teuthology.orchestra.run.trial101.stdout: python3-threadpoolctl python3-toml python3-waitress python3-wcwidth 2026-02-22T22:16:31.302 INFO:teuthology.orchestra.run.trial101.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2026-02-22T22:16:31.302 INFO:teuthology.orchestra.run.trial101.stdout: python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse socat unzip 2026-02-22T22:16:31.302 INFO:teuthology.orchestra.run.trial101.stdout: xmlstarlet zip 2026-02-22T22:16:31.323 INFO:teuthology.orchestra.run.trial061.stdout:The following NEW packages will be installed: 2026-02-22T22:16:31.323 INFO:teuthology.orchestra.run.trial061.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-22T22:16:31.323 INFO:teuthology.orchestra.run.trial061.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-22T22:16:31.324 INFO:teuthology.orchestra.run.trial061.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2026-02-22T22:16:31.324 INFO:teuthology.orchestra.run.trial061.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 2026-02-22T22:16:31.324 INFO:teuthology.orchestra.run.trial061.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2026-02-22T22:16:31.324 INFO:teuthology.orchestra.run.trial061.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2026-02-22T22:16:31.324 INFO:teuthology.orchestra.run.trial061.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2026-02-22T22:16:31.324 INFO:teuthology.orchestra.run.trial061.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2026-02-22T22:16:31.324 INFO:teuthology.orchestra.run.trial061.stdout: python-pastedeploy-tpl python3-asyncssh python3-cachetools 2026-02-22T22:16:31.324 INFO:teuthology.orchestra.run.trial061.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cheroot 2026-02-22T22:16:31.324 INFO:teuthology.orchestra.run.trial061.stdout: python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-22T22:16:31.324 INFO:teuthology.orchestra.run.trial061.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-22T22:16:31.324 INFO:teuthology.orchestra.run.trial061.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-logutils 2026-02-22T22:16:31.324 INFO:teuthology.orchestra.run.trial061.stdout: python3-mako python3-natsort python3-paste python3-pastedeploy 2026-02-22T22:16:31.324 INFO:teuthology.orchestra.run.trial061.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2026-02-22T22:16:31.325 INFO:teuthology.orchestra.run.trial061.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-22T22:16:31.325 INFO:teuthology.orchestra.run.trial061.stdout: python3-pyinotify python3-pytest python3-rados python3-rbd 2026-02-22T22:16:31.325 INFO:teuthology.orchestra.run.trial061.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2026-02-22T22:16:31.325 INFO:teuthology.orchestra.run.trial061.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2026-02-22T22:16:31.325 INFO:teuthology.orchestra.run.trial061.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2026-02-22T22:16:31.325 INFO:teuthology.orchestra.run.trial061.stdout: python3-threadpoolctl python3-toml python3-waitress python3-wcwidth 2026-02-22T22:16:31.325 INFO:teuthology.orchestra.run.trial061.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2026-02-22T22:16:31.325 INFO:teuthology.orchestra.run.trial061.stdout: python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse socat unzip 2026-02-22T22:16:31.325 INFO:teuthology.orchestra.run.trial061.stdout: xmlstarlet zip 2026-02-22T22:16:31.381 INFO:teuthology.orchestra.run.trial101.stdout:0 upgraded, 108 newly installed, 0 to remove and 13 not upgraded. 2026-02-22T22:16:31.381 INFO:teuthology.orchestra.run.trial101.stdout:Need to get 178 MB of archives. 2026-02-22T22:16:31.381 INFO:teuthology.orchestra.run.trial101.stdout:After this operation, 809 MB of additional disk space will be used. 2026-02-22T22:16:31.382 INFO:teuthology.orchestra.run.trial101.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.2.3-689-gf90f4eae-1jammy [3597 kB] 2026-02-22T22:16:31.402 INFO:teuthology.orchestra.run.trial061.stdout:0 upgraded, 108 newly installed, 0 to remove and 13 not upgraded. 2026-02-22T22:16:31.402 INFO:teuthology.orchestra.run.trial061.stdout:Need to get 178 MB of archives. 2026-02-22T22:16:31.402 INFO:teuthology.orchestra.run.trial061.stdout:After this operation, 809 MB of additional disk space will be used. 2026-02-22T22:16:31.403 INFO:teuthology.orchestra.run.trial061.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.2.3-689-gf90f4eae-1jammy [3597 kB] 2026-02-22T22:16:31.424 INFO:teuthology.orchestra.run.trial061.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-22T22:16:31.467 INFO:teuthology.orchestra.run.trial061.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-22T22:16:31.468 INFO:teuthology.orchestra.run.trial061.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-22T22:16:31.476 INFO:teuthology.orchestra.run.trial061.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-22T22:16:31.503 INFO:teuthology.orchestra.run.trial061.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-22T22:16:31.505 INFO:teuthology.orchestra.run.trial061.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-22T22:16:31.506 INFO:teuthology.orchestra.run.trial101.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.2.3-689-gf90f4eae-1jammy [3256 kB] 2026-02-22T22:16:31.510 INFO:teuthology.orchestra.run.trial061.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-22T22:16:31.512 INFO:teuthology.orchestra.run.trial061.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-22T22:16:31.513 INFO:teuthology.orchestra.run.trial061.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-22T22:16:31.513 INFO:teuthology.orchestra.run.trial061.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-22T22:16:31.513 INFO:teuthology.orchestra.run.trial061.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-22T22:16:31.518 INFO:teuthology.orchestra.run.trial061.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2026-02-22T22:16:31.519 INFO:teuthology.orchestra.run.trial061.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2026-02-22T22:16:31.520 INFO:teuthology.orchestra.run.trial061.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2026-02-22T22:16:31.522 INFO:teuthology.orchestra.run.trial061.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5034 B] 2026-02-22T22:16:31.523 INFO:teuthology.orchestra.run.trial061.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2026-02-22T22:16:31.524 INFO:teuthology.orchestra.run.trial061.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2026-02-22T22:16:31.525 INFO:teuthology.orchestra.run.trial061.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2026-02-22T22:16:31.531 INFO:teuthology.orchestra.run.trial061.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-22T22:16:31.532 INFO:teuthology.orchestra.run.trial061.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-22T22:16:31.532 INFO:teuthology.orchestra.run.trial061.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-22T22:16:31.533 INFO:teuthology.orchestra.run.trial061.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-22T22:16:31.533 INFO:teuthology.orchestra.run.trial061.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-22T22:16:31.533 INFO:teuthology.orchestra.run.trial061.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-22T22:16:31.540 INFO:teuthology.orchestra.run.trial061.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-22T22:16:31.541 INFO:teuthology.orchestra.run.trial061.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-22T22:16:31.541 INFO:teuthology.orchestra.run.trial061.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-22T22:16:31.541 INFO:teuthology.orchestra.run.trial061.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-22T22:16:31.549 INFO:teuthology.orchestra.run.trial061.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-22T22:16:31.550 INFO:teuthology.orchestra.run.trial061.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2026-02-22T22:16:31.550 INFO:teuthology.orchestra.run.trial061.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2026-02-22T22:16:31.551 INFO:teuthology.orchestra.run.trial061.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2026-02-22T22:16:31.551 INFO:teuthology.orchestra.run.trial061.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7320 B] 2026-02-22T22:16:31.551 INFO:teuthology.orchestra.run.trial061.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-22T22:16:31.558 INFO:teuthology.orchestra.run.trial061.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-waitress all 1.4.4-1.1ubuntu1.1 [47.0 kB] 2026-02-22T22:16:31.559 INFO:teuthology.orchestra.run.trial061.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2026-02-22T22:16:31.559 INFO:teuthology.orchestra.run.trial061.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2026-02-22T22:16:31.562 INFO:teuthology.orchestra.run.trial061.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4892 B] 2026-02-22T22:16:31.567 INFO:teuthology.orchestra.run.trial061.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2026-02-22T22:16:31.568 INFO:teuthology.orchestra.run.trial061.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2026-02-22T22:16:31.568 INFO:teuthology.orchestra.run.trial061.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2026-02-22T22:16:31.569 INFO:teuthology.orchestra.run.trial061.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.3 [181 kB] 2026-02-22T22:16:31.570 INFO:teuthology.orchestra.run.trial061.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-22T22:16:31.571 INFO:teuthology.orchestra.run.trial061.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-22T22:16:31.576 INFO:teuthology.orchestra.run.trial061.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-22T22:16:31.576 INFO:teuthology.orchestra.run.trial061.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-22T22:16:31.577 INFO:teuthology.orchestra.run.trial061.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-22T22:16:31.580 INFO:teuthology.orchestra.run.trial101.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.2.3-689-gf90f4eae-1jammy [979 kB] 2026-02-22T22:16:31.591 INFO:teuthology.orchestra.run.trial061.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-22T22:16:31.593 INFO:teuthology.orchestra.run.trial061.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-22T22:16:31.593 INFO:teuthology.orchestra.run.trial061.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-22T22:16:31.595 INFO:teuthology.orchestra.run.trial101.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.2.3-689-gf90f4eae-1jammy [357 kB] 2026-02-22T22:16:31.601 INFO:teuthology.orchestra.run.trial101.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.2.3-689-gf90f4eae-1jammy [32.9 kB] 2026-02-22T22:16:31.602 INFO:teuthology.orchestra.run.trial061.stdout:Get:52 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.2.3-689-gf90f4eae-1jammy [3256 kB] 2026-02-22T22:16:31.602 INFO:teuthology.orchestra.run.trial101.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.2.3-689-gf90f4eae-1jammy [184 kB] 2026-02-22T22:16:31.604 INFO:teuthology.orchestra.run.trial061.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-22T22:16:31.604 INFO:teuthology.orchestra.run.trial061.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-22T22:16:31.604 INFO:teuthology.orchestra.run.trial061.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-22T22:16:31.605 INFO:teuthology.orchestra.run.trial061.stdout:Get:56 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-22T22:16:31.605 INFO:teuthology.orchestra.run.trial061.stdout:Get:57 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-22T22:16:31.605 INFO:teuthology.orchestra.run.trial061.stdout:Get:58 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-22T22:16:31.606 INFO:teuthology.orchestra.run.trial061.stdout:Get:59 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-22T22:16:31.612 INFO:teuthology.orchestra.run.trial061.stdout:Get:60 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-22T22:16:31.613 INFO:teuthology.orchestra.run.trial061.stdout:Get:61 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-22T22:16:31.616 INFO:teuthology.orchestra.run.trial061.stdout:Get:62 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-22T22:16:31.618 INFO:teuthology.orchestra.run.trial061.stdout:Get:63 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-22T22:16:31.620 INFO:teuthology.orchestra.run.trial061.stdout:Get:64 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2026-02-22T22:16:31.620 INFO:teuthology.orchestra.run.trial061.stdout:Get:65 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2026-02-22T22:16:31.621 INFO:teuthology.orchestra.run.trial061.stdout:Get:66 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-22T22:16:31.623 INFO:teuthology.orchestra.run.trial061.stdout:Get:67 https://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2026-02-22T22:16:31.623 INFO:teuthology.orchestra.run.trial061.stdout:Get:68 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-22T22:16:31.623 INFO:teuthology.orchestra.run.trial101.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.2.3-689-gf90f4eae-1jammy [70.0 kB] 2026-02-22T22:16:31.624 INFO:teuthology.orchestra.run.trial061.stdout:Get:69 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-22T22:16:31.625 INFO:teuthology.orchestra.run.trial101.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.2.3-689-gf90f4eae-1jammy [335 kB] 2026-02-22T22:16:31.629 INFO:teuthology.orchestra.run.trial061.stdout:Get:70 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2026-02-22T22:16:31.630 INFO:teuthology.orchestra.run.trial101.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.2.3-689-gf90f4eae-1jammy [6935 kB] 2026-02-22T22:16:31.630 INFO:teuthology.orchestra.run.trial061.stdout:Get:71 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-22T22:16:31.630 INFO:teuthology.orchestra.run.trial061.stdout:Get:72 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-22T22:16:31.639 INFO:teuthology.orchestra.run.trial061.stdout:Get:73 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-22T22:16:31.639 INFO:teuthology.orchestra.run.trial061.stdout:Get:74 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-22T22:16:31.642 INFO:teuthology.orchestra.run.trial061.stdout:Get:75 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2026-02-22T22:16:31.643 INFO:teuthology.orchestra.run.trial061.stdout:Get:76 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-22T22:16:31.643 INFO:teuthology.orchestra.run.trial061.stdout:Get:77 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-22T22:16:31.643 INFO:teuthology.orchestra.run.trial061.stdout:Get:78 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-22T22:16:31.644 INFO:teuthology.orchestra.run.trial061.stdout:Get:79 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-22T22:16:31.716 INFO:teuthology.orchestra.run.trial101.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-22T22:16:31.723 INFO:teuthology.orchestra.run.trial061.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.2.3-689-gf90f4eae-1jammy [979 kB] 2026-02-22T22:16:31.774 INFO:teuthology.orchestra.run.trial061.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.2.3-689-gf90f4eae-1jammy [357 kB] 2026-02-22T22:16:31.780 INFO:teuthology.orchestra.run.trial061.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.2.3-689-gf90f4eae-1jammy [32.9 kB] 2026-02-22T22:16:31.781 INFO:teuthology.orchestra.run.trial061.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.2.3-689-gf90f4eae-1jammy [184 kB] 2026-02-22T22:16:31.784 INFO:teuthology.orchestra.run.trial061.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.2.3-689-gf90f4eae-1jammy [70.0 kB] 2026-02-22T22:16:31.786 INFO:teuthology.orchestra.run.trial061.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.2.3-689-gf90f4eae-1jammy [335 kB] 2026-02-22T22:16:31.809 INFO:teuthology.orchestra.run.trial101.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.2.3-689-gf90f4eae-1jammy [112 kB] 2026-02-22T22:16:31.809 INFO:teuthology.orchestra.run.trial101.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.2.3-689-gf90f4eae-1jammy [470 kB] 2026-02-22T22:16:31.816 INFO:teuthology.orchestra.run.trial101.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.2.3-689-gf90f4eae-1jammy [26.5 MB] 2026-02-22T22:16:31.827 INFO:teuthology.orchestra.run.trial061.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.2.3-689-gf90f4eae-1jammy [6935 kB] 2026-02-22T22:16:32.127 INFO:teuthology.orchestra.run.trial101.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-22T22:16:32.140 INFO:teuthology.orchestra.run.trial101.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-22T22:16:32.143 INFO:teuthology.orchestra.run.trial061.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.2.3-689-gf90f4eae-1jammy [112 kB] 2026-02-22T22:16:32.144 INFO:teuthology.orchestra.run.trial061.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.2.3-689-gf90f4eae-1jammy [470 kB] 2026-02-22T22:16:32.147 INFO:teuthology.orchestra.run.trial061.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.2.3-689-gf90f4eae-1jammy [26.5 MB] 2026-02-22T22:16:32.225 INFO:teuthology.orchestra.run.trial101.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-22T22:16:32.469 INFO:teuthology.orchestra.run.trial101.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-22T22:16:32.481 INFO:teuthology.orchestra.run.trial101.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-22T22:16:32.513 INFO:teuthology.orchestra.run.trial101.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-22T22:16:32.524 INFO:teuthology.orchestra.run.trial101.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-22T22:16:32.526 INFO:teuthology.orchestra.run.trial101.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-22T22:16:32.527 INFO:teuthology.orchestra.run.trial101.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-22T22:16:32.528 INFO:teuthology.orchestra.run.trial101.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-22T22:16:32.542 INFO:teuthology.orchestra.run.trial101.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.2.3-689-gf90f4eae-1jammy [5178 kB] 2026-02-22T22:16:32.548 INFO:teuthology.orchestra.run.trial101.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2026-02-22T22:16:32.553 INFO:teuthology.orchestra.run.trial101.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2026-02-22T22:16:32.558 INFO:teuthology.orchestra.run.trial101.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2026-02-22T22:16:32.642 INFO:teuthology.orchestra.run.trial101.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5034 B] 2026-02-22T22:16:32.642 INFO:teuthology.orchestra.run.trial101.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2026-02-22T22:16:32.644 INFO:teuthology.orchestra.run.trial101.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2026-02-22T22:16:32.646 INFO:teuthology.orchestra.run.trial101.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2026-02-22T22:16:32.648 INFO:teuthology.orchestra.run.trial101.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-22T22:16:32.649 INFO:teuthology.orchestra.run.trial101.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-22T22:16:32.649 INFO:teuthology.orchestra.run.trial101.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-22T22:16:32.650 INFO:teuthology.orchestra.run.trial101.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-22T22:16:32.685 INFO:teuthology.orchestra.run.trial101.stdout:Get:36 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.2.3-689-gf90f4eae-1jammy [248 kB] 2026-02-22T22:16:32.688 INFO:teuthology.orchestra.run.trial101.stdout:Get:37 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.2.3-689-gf90f4eae-1jammy [125 kB] 2026-02-22T22:16:32.690 INFO:teuthology.orchestra.run.trial101.stdout:Get:38 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.2.3-689-gf90f4eae-1jammy [1081 kB] 2026-02-22T22:16:32.728 INFO:teuthology.orchestra.run.trial101.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.2.3-689-gf90f4eae-1jammy [6239 kB] 2026-02-22T22:16:32.736 INFO:teuthology.orchestra.run.trial101.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-22T22:16:32.736 INFO:teuthology.orchestra.run.trial101.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-22T22:16:32.737 INFO:teuthology.orchestra.run.trial101.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-22T22:16:32.737 INFO:teuthology.orchestra.run.trial101.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-22T22:16:32.737 INFO:teuthology.orchestra.run.trial101.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-22T22:16:32.823 INFO:teuthology.orchestra.run.trial101.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-22T22:16:32.826 INFO:teuthology.orchestra.run.trial101.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-22T22:16:32.827 INFO:teuthology.orchestra.run.trial101.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2026-02-22T22:16:32.827 INFO:teuthology.orchestra.run.trial101.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2026-02-22T22:16:32.828 INFO:teuthology.orchestra.run.trial101.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2026-02-22T22:16:32.895 INFO:teuthology.orchestra.run.trial101.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.2.3-689-gf90f4eae-1jammy [23.0 MB] 2026-02-22T22:16:32.911 INFO:teuthology.orchestra.run.trial101.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7320 B] 2026-02-22T22:16:32.911 INFO:teuthology.orchestra.run.trial101.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-22T22:16:32.912 INFO:teuthology.orchestra.run.trial101.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-waitress all 1.4.4-1.1ubuntu1.1 [47.0 kB] 2026-02-22T22:16:32.913 INFO:teuthology.orchestra.run.trial101.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2026-02-22T22:16:32.913 INFO:teuthology.orchestra.run.trial101.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2026-02-22T22:16:32.999 INFO:teuthology.orchestra.run.trial101.stdout:Get:56 https://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4892 B] 2026-02-22T22:16:32.999 INFO:teuthology.orchestra.run.trial101.stdout:Get:57 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2026-02-22T22:16:33.000 INFO:teuthology.orchestra.run.trial101.stdout:Get:58 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2026-02-22T22:16:33.000 INFO:teuthology.orchestra.run.trial101.stdout:Get:59 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2026-02-22T22:16:33.001 INFO:teuthology.orchestra.run.trial101.stdout:Get:60 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.3 [181 kB] 2026-02-22T22:16:33.087 INFO:teuthology.orchestra.run.trial101.stdout:Get:61 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-22T22:16:33.088 INFO:teuthology.orchestra.run.trial101.stdout:Get:62 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-22T22:16:33.090 INFO:teuthology.orchestra.run.trial101.stdout:Get:63 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-22T22:16:33.091 INFO:teuthology.orchestra.run.trial101.stdout:Get:64 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-22T22:16:33.092 INFO:teuthology.orchestra.run.trial101.stdout:Get:65 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-22T22:16:33.174 INFO:teuthology.orchestra.run.trial101.stdout:Get:66 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-22T22:16:33.177 INFO:teuthology.orchestra.run.trial101.stdout:Get:67 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-22T22:16:33.177 INFO:teuthology.orchestra.run.trial101.stdout:Get:68 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-22T22:16:33.201 INFO:teuthology.orchestra.run.trial101.stdout:Get:69 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-22T22:16:33.202 INFO:teuthology.orchestra.run.trial101.stdout:Get:70 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-22T22:16:33.227 INFO:teuthology.orchestra.run.trial061.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.2.3-689-gf90f4eae-1jammy [5178 kB] 2026-02-22T22:16:33.262 INFO:teuthology.orchestra.run.trial101.stdout:Get:71 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-22T22:16:33.263 INFO:teuthology.orchestra.run.trial101.stdout:Get:72 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-22T22:16:33.263 INFO:teuthology.orchestra.run.trial101.stdout:Get:73 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-22T22:16:33.263 INFO:teuthology.orchestra.run.trial101.stdout:Get:74 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-22T22:16:33.267 INFO:teuthology.orchestra.run.trial101.stdout:Get:75 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-22T22:16:33.350 INFO:teuthology.orchestra.run.trial101.stdout:Get:76 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-22T22:16:33.351 INFO:teuthology.orchestra.run.trial101.stdout:Get:77 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-22T22:16:33.352 INFO:teuthology.orchestra.run.trial101.stdout:Get:78 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-22T22:16:33.356 INFO:teuthology.orchestra.run.trial101.stdout:Get:79 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-22T22:16:33.359 INFO:teuthology.orchestra.run.trial101.stdout:Get:80 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2026-02-22T22:16:33.438 INFO:teuthology.orchestra.run.trial101.stdout:Get:81 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2026-02-22T22:16:33.438 INFO:teuthology.orchestra.run.trial101.stdout:Get:82 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-22T22:16:33.444 INFO:teuthology.orchestra.run.trial101.stdout:Get:83 https://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2026-02-22T22:16:33.444 INFO:teuthology.orchestra.run.trial101.stdout:Get:84 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-22T22:16:33.448 INFO:teuthology.orchestra.run.trial101.stdout:Get:85 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-22T22:16:33.451 INFO:teuthology.orchestra.run.trial061.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.2.3-689-gf90f4eae-1jammy [248 kB] 2026-02-22T22:16:33.454 INFO:teuthology.orchestra.run.trial061.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.2.3-689-gf90f4eae-1jammy [125 kB] 2026-02-22T22:16:33.457 INFO:teuthology.orchestra.run.trial061.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.2.3-689-gf90f4eae-1jammy [1081 kB] 2026-02-22T22:16:33.495 INFO:teuthology.orchestra.run.trial101.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.2.3-689-gf90f4eae-1jammy [14.2 kB] 2026-02-22T22:16:33.495 INFO:teuthology.orchestra.run.trial101.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.2.3-689-gf90f4eae-1jammy [1173 kB] 2026-02-22T22:16:33.510 INFO:teuthology.orchestra.run.trial061.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.2.3-689-gf90f4eae-1jammy [6239 kB] 2026-02-22T22:16:33.525 INFO:teuthology.orchestra.run.trial101.stdout:Get:88 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2026-02-22T22:16:33.526 INFO:teuthology.orchestra.run.trial101.stdout:Get:89 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-22T22:16:33.526 INFO:teuthology.orchestra.run.trial101.stdout:Get:90 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-22T22:16:33.528 INFO:teuthology.orchestra.run.trial101.stdout:Get:91 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-22T22:16:33.529 INFO:teuthology.orchestra.run.trial101.stdout:Get:92 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-22T22:16:33.533 INFO:teuthology.orchestra.run.trial101.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.2.3-689-gf90f4eae-1jammy [2503 kB] 2026-02-22T22:16:33.598 INFO:teuthology.orchestra.run.trial101.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.2.3-689-gf90f4eae-1jammy [798 kB] 2026-02-22T22:16:33.612 INFO:teuthology.orchestra.run.trial101.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.2.3-689-gf90f4eae-1jammy [157 kB] 2026-02-22T22:16:33.613 INFO:teuthology.orchestra.run.trial101.stdout:Get:96 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2026-02-22T22:16:33.613 INFO:teuthology.orchestra.run.trial101.stdout:Get:97 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-22T22:16:33.614 INFO:teuthology.orchestra.run.trial101.stdout:Get:98 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-22T22:16:33.616 INFO:teuthology.orchestra.run.trial101.stdout:Get:99 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-22T22:16:33.617 INFO:teuthology.orchestra.run.trial101.stdout:Get:100 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-22T22:16:33.619 INFO:teuthology.orchestra.run.trial101.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.2.3-689-gf90f4eae-1jammy [2396 kB] 2026-02-22T22:16:33.697 INFO:teuthology.orchestra.run.trial101.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.2.3-689-gf90f4eae-1jammy [8625 kB] 2026-02-22T22:16:33.794 INFO:teuthology.orchestra.run.trial061.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.2.3-689-gf90f4eae-1jammy [23.0 MB] 2026-02-22T22:16:33.911 INFO:teuthology.orchestra.run.trial101.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.2.3-689-gf90f4eae-1jammy [14.3 kB] 2026-02-22T22:16:33.911 INFO:teuthology.orchestra.run.trial101.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.2.3-689-gf90f4eae-1jammy [52.1 MB] 2026-02-22T22:16:34.746 INFO:teuthology.orchestra.run.trial061.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.2.3-689-gf90f4eae-1jammy [14.2 kB] 2026-02-22T22:16:34.746 INFO:teuthology.orchestra.run.trial061.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.2.3-689-gf90f4eae-1jammy [1173 kB] 2026-02-22T22:16:34.801 INFO:teuthology.orchestra.run.trial061.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.2.3-689-gf90f4eae-1jammy [2503 kB] 2026-02-22T22:16:34.921 INFO:teuthology.orchestra.run.trial061.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.2.3-689-gf90f4eae-1jammy [798 kB] 2026-02-22T22:16:34.934 INFO:teuthology.orchestra.run.trial061.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.2.3-689-gf90f4eae-1jammy [157 kB] 2026-02-22T22:16:34.939 INFO:teuthology.orchestra.run.trial061.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.2.3-689-gf90f4eae-1jammy [2396 kB] 2026-02-22T22:16:35.056 INFO:teuthology.orchestra.run.trial061.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.2.3-689-gf90f4eae-1jammy [8625 kB] 2026-02-22T22:16:35.312 INFO:teuthology.orchestra.run.trial101.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.2.3-689-gf90f4eae-1jammy [135 kB] 2026-02-22T22:16:35.313 INFO:teuthology.orchestra.run.trial101.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.2.3-689-gf90f4eae-1jammy [41.0 kB] 2026-02-22T22:16:35.313 INFO:teuthology.orchestra.run.trial101.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.2.3-689-gf90f4eae-1jammy [13.7 MB] 2026-02-22T22:16:35.404 INFO:teuthology.orchestra.run.trial061.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.2.3-689-gf90f4eae-1jammy [14.3 kB] 2026-02-22T22:16:35.404 INFO:teuthology.orchestra.run.trial061.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.2.3-689-gf90f4eae-1jammy [52.1 MB] 2026-02-22T22:16:35.688 INFO:teuthology.orchestra.run.trial101.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.2.3-689-gf90f4eae-1jammy [92.3 kB] 2026-02-22T22:16:36.006 INFO:teuthology.orchestra.run.trial101.stdout:Fetched 178 MB in 4s (40.5 MB/s) 2026-02-22T22:16:36.026 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-22T22:16:36.185 INFO:teuthology.orchestra.run.trial101.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167442 files and directories currently installed.) 2026-02-22T22:16:36.187 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-22T22:16:36.189 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-22T22:16:36.209 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-22T22:16:36.217 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-22T22:16:36.217 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-22T22:16:36.233 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-22T22:16:36.244 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-22T22:16:36.245 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-22T22:16:36.264 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-22T22:16:36.272 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-22T22:16:36.277 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T22:16:36.309 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-22T22:16:36.317 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-22T22:16:36.318 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T22:16:36.333 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-22T22:16:36.341 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-22T22:16:36.342 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T22:16:36.361 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-22T22:16:36.369 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-22T22:16:36.370 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-22T22:16:36.386 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package librados2. 2026-02-22T22:16:36.394 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../007-librados2_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:36.395 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking librados2 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:36.438 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package libnbd0. 2026-02-22T22:16:36.442 INFO:teuthology.orchestra.run.trial061.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.2.3-689-gf90f4eae-1jammy [135 kB] 2026-02-22T22:16:36.443 INFO:teuthology.orchestra.run.trial061.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.2.3-689-gf90f4eae-1jammy [41.0 kB] 2026-02-22T22:16:36.443 INFO:teuthology.orchestra.run.trial061.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.2.3-689-gf90f4eae-1jammy [13.7 MB] 2026-02-22T22:16:36.446 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2026-02-22T22:16:36.447 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-22T22:16:36.461 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package librbd1. 2026-02-22T22:16:36.469 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../009-librbd1_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:36.469 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking librbd1 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:36.512 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package libcephfs2. 2026-02-22T22:16:36.520 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../010-libcephfs2_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:36.520 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking libcephfs2 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:36.541 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-rados. 2026-02-22T22:16:36.549 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../011-python3-rados_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:36.549 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-rados (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:36.565 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-22T22:16:36.574 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T22:16:36.574 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-ceph-argparse (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:36.588 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-cephfs. 2026-02-22T22:16:36.596 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../013-python3-cephfs_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:36.596 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-cephfs (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:36.612 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-22T22:16:36.620 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../014-python3-ceph-common_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T22:16:36.621 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-ceph-common (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:36.638 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-22T22:16:36.646 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-22T22:16:36.646 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-22T22:16:36.661 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-prettytable. 2026-02-22T22:16:36.662 INFO:teuthology.orchestra.run.trial061.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-22-1629-squid/f90f4eaebb28b619cf76e80cbbe997656da69579/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.2.3-689-gf90f4eae-1jammy [92.3 kB] 2026-02-22T22:16:36.670 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2026-02-22T22:16:36.670 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-22T22:16:36.684 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-rbd. 2026-02-22T22:16:36.692 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../017-python3-rbd_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:36.692 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-rbd (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:36.709 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-22T22:16:36.718 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-22T22:16:36.718 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-22T22:16:36.736 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package libreadline-dev:amd64. 2026-02-22T22:16:36.744 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2026-02-22T22:16:36.744 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2026-02-22T22:16:36.763 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2026-02-22T22:16:36.772 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2026-02-22T22:16:36.772 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2026-02-22T22:16:36.789 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package lua5.1. 2026-02-22T22:16:36.797 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2026-02-22T22:16:36.798 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2026-02-22T22:16:36.817 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package lua-any. 2026-02-22T22:16:36.825 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2026-02-22T22:16:36.826 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking lua-any (27ubuntu1) ... 2026-02-22T22:16:36.839 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package zip. 2026-02-22T22:16:36.847 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2026-02-22T22:16:36.847 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking zip (3.0-12build2) ... 2026-02-22T22:16:36.864 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package unzip. 2026-02-22T22:16:36.872 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2026-02-22T22:16:36.872 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2026-02-22T22:16:36.891 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package luarocks. 2026-02-22T22:16:36.899 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2026-02-22T22:16:36.899 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2026-02-22T22:16:36.937 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package librgw2. 2026-02-22T22:16:36.945 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../026-librgw2_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:36.945 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking librgw2 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:36.981 INFO:teuthology.orchestra.run.trial061.stdout:Fetched 178 MB in 5s (33.3 MB/s) 2026-02-22T22:16:36.997 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-22T22:16:37.019 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-rgw. 2026-02-22T22:16:37.027 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../027-python3-rgw_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:37.028 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-rgw (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:37.042 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-22T22:16:37.050 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../028-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-22T22:16:37.051 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-22T22:16:37.065 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package libradosstriper1. 2026-02-22T22:16:37.073 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../029-libradosstriper1_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:37.074 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking libradosstriper1 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:37.091 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package ceph-common. 2026-02-22T22:16:37.099 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../030-ceph-common_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:37.099 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking ceph-common (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:37.154 INFO:teuthology.orchestra.run.trial061.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167442 files and directories currently installed.) 2026-02-22T22:16:37.156 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-22T22:16:37.158 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-22T22:16:37.175 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-22T22:16:37.183 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-22T22:16:37.184 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-22T22:16:37.200 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-22T22:16:37.212 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-22T22:16:37.212 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-22T22:16:37.229 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-22T22:16:37.238 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-22T22:16:37.242 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T22:16:37.274 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-22T22:16:37.282 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-22T22:16:37.282 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T22:16:37.299 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-22T22:16:37.300 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package ceph-base. 2026-02-22T22:16:37.307 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-22T22:16:37.307 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T22:16:37.309 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../031-ceph-base_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:37.314 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking ceph-base (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:37.326 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-22T22:16:37.334 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-22T22:16:37.335 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-22T22:16:37.351 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package librados2. 2026-02-22T22:16:37.359 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../007-librados2_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:37.359 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking librados2 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:37.376 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-22T22:16:37.385 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-22T22:16:37.385 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-22T22:16:37.400 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-cheroot. 2026-02-22T22:16:37.409 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-22T22:16:37.410 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libnbd0. 2026-02-22T22:16:37.410 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-22T22:16:37.417 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2026-02-22T22:16:37.417 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-22T22:16:37.426 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-22T22:16:37.432 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package librbd1. 2026-02-22T22:16:37.434 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-22T22:16:37.435 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-22T22:16:37.440 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../009-librbd1_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:37.440 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking librbd1 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:37.449 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-22T22:16:37.457 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-22T22:16:37.458 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-22T22:16:37.472 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-22T22:16:37.480 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-22T22:16:37.480 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-22T22:16:37.481 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libcephfs2. 2026-02-22T22:16:37.489 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../010-libcephfs2_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:37.490 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libcephfs2 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:37.495 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-tempora. 2026-02-22T22:16:37.503 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2026-02-22T22:16:37.503 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-22T22:16:37.510 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-rados. 2026-02-22T22:16:37.518 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-portend. 2026-02-22T22:16:37.519 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../011-python3-rados_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:37.519 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-rados (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:37.526 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2026-02-22T22:16:37.527 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-22T22:16:37.536 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-22T22:16:37.541 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-22T22:16:37.544 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T22:16:37.545 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-ceph-argparse (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:37.550 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-22T22:16:37.550 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-22T22:16:37.558 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-cephfs. 2026-02-22T22:16:37.564 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-22T22:16:37.566 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../013-python3-cephfs_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:37.567 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-cephfs (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:37.573 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-22T22:16:37.573 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-22T22:16:37.583 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-22T22:16:37.591 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../014-python3-ceph-common_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T22:16:37.591 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-ceph-common (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:37.595 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-natsort. 2026-02-22T22:16:37.604 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2026-02-22T22:16:37.604 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-22T22:16:37.609 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-22T22:16:37.617 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-22T22:16:37.617 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-22T22:16:37.619 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-logutils. 2026-02-22T22:16:37.628 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2026-02-22T22:16:37.628 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-logutils (0.3.3-8) ... 2026-02-22T22:16:37.633 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-prettytable. 2026-02-22T22:16:37.641 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2026-02-22T22:16:37.641 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-22T22:16:37.643 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-mako. 2026-02-22T22:16:37.651 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2026-02-22T22:16:37.652 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2026-02-22T22:16:37.656 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-rbd. 2026-02-22T22:16:37.664 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../017-python3-rbd_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:37.665 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-rbd (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:37.668 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-simplegeneric. 2026-02-22T22:16:37.677 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2026-02-22T22:16:37.677 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2026-02-22T22:16:37.682 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-22T22:16:37.690 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-22T22:16:37.690 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-22T22:16:37.692 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-singledispatch. 2026-02-22T22:16:37.700 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2026-02-22T22:16:37.700 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2026-02-22T22:16:37.708 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libreadline-dev:amd64. 2026-02-22T22:16:37.714 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-webob. 2026-02-22T22:16:37.716 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2026-02-22T22:16:37.717 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2026-02-22T22:16:37.723 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-22T22:16:37.723 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-22T22:16:37.734 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2026-02-22T22:16:37.740 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-waitress. 2026-02-22T22:16:37.742 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2026-02-22T22:16:37.743 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2026-02-22T22:16:37.748 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1.1_all.deb ... 2026-02-22T22:16:37.750 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1.1) ... 2026-02-22T22:16:37.760 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package lua5.1. 2026-02-22T22:16:37.765 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-tempita. 2026-02-22T22:16:37.768 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2026-02-22T22:16:37.768 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2026-02-22T22:16:37.773 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2026-02-22T22:16:37.774 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2026-02-22T22:16:37.787 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package lua-any. 2026-02-22T22:16:37.787 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-paste. 2026-02-22T22:16:37.795 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2026-02-22T22:16:37.796 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking lua-any (27ubuntu1) ... 2026-02-22T22:16:37.796 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2026-02-22T22:16:37.796 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2026-02-22T22:16:37.809 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package zip. 2026-02-22T22:16:37.817 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2026-02-22T22:16:37.818 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking zip (3.0-12build2) ... 2026-02-22T22:16:37.824 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2026-02-22T22:16:37.832 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2026-02-22T22:16:37.832 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2026-02-22T22:16:37.834 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package unzip. 2026-02-22T22:16:37.843 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2026-02-22T22:16:37.843 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2026-02-22T22:16:37.846 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-pastedeploy. 2026-02-22T22:16:37.855 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2026-02-22T22:16:37.855 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2026-02-22T22:16:37.860 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package luarocks. 2026-02-22T22:16:37.869 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2026-02-22T22:16:37.869 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2026-02-22T22:16:37.870 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-webtest. 2026-02-22T22:16:37.878 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2026-02-22T22:16:37.878 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-webtest (2.0.35-1) ... 2026-02-22T22:16:37.894 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-pecan. 2026-02-22T22:16:37.902 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2026-02-22T22:16:37.903 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2026-02-22T22:16:37.906 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package librgw2. 2026-02-22T22:16:37.915 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../026-librgw2_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:37.915 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking librgw2 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:37.927 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-werkzeug. 2026-02-22T22:16:37.935 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.3_all.deb ... 2026-02-22T22:16:37.935 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.3) ... 2026-02-22T22:16:37.955 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-22T22:16:37.963 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T22:16:37.963 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking ceph-mgr-modules-core (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:37.989 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-rgw. 2026-02-22T22:16:37.991 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-22T22:16:37.998 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../027-python3-rgw_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:37.998 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-rgw (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:37.999 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:37.999 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking libsqlite3-mod-ceph (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:38.013 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-22T22:16:38.014 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package ceph-mgr. 2026-02-22T22:16:38.021 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../028-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-22T22:16:38.021 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-22T22:16:38.022 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../057-ceph-mgr_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:38.022 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking ceph-mgr (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:38.036 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libradosstriper1. 2026-02-22T22:16:38.044 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package ceph-mon. 2026-02-22T22:16:38.044 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../029-libradosstriper1_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:38.045 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libradosstriper1 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:38.052 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../058-ceph-mon_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:38.052 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking ceph-mon (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:38.063 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-common. 2026-02-22T22:16:38.071 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../030-ceph-common_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:38.071 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-common (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:38.108 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-22T22:16:38.117 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../059-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-22T22:16:38.117 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-22T22:16:38.133 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package ceph-osd. 2026-02-22T22:16:38.141 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../060-ceph-osd_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:38.141 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking ceph-osd (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:38.277 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-base. 2026-02-22T22:16:38.285 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../031-ceph-base_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:38.290 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-base (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:38.295 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package ceph. 2026-02-22T22:16:38.304 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../061-ceph_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:38.304 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking ceph (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:38.319 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package ceph-fuse. 2026-02-22T22:16:38.327 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../062-ceph-fuse_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:38.327 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking ceph-fuse (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:38.349 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package ceph-mds. 2026-02-22T22:16:38.354 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-22T22:16:38.358 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../063-ceph-mds_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:38.358 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking ceph-mds (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:38.363 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-22T22:16:38.363 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-22T22:16:38.378 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-cheroot. 2026-02-22T22:16:38.386 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-22T22:16:38.386 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-22T22:16:38.392 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package cephadm. 2026-02-22T22:16:38.400 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../064-cephadm_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:38.401 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking cephadm (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:38.403 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-22T22:16:38.412 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-22T22:16:38.412 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-22T22:16:38.417 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-22T22:16:38.426 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-22T22:16:38.426 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-22T22:16:38.427 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-22T22:16:38.435 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-22T22:16:38.435 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-22T22:16:38.447 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-22T22:16:38.449 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-22T22:16:38.455 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../066-ceph-mgr-cephadm_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T22:16:38.456 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking ceph-mgr-cephadm (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:38.458 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-22T22:16:38.458 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-22T22:16:38.472 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-tempora. 2026-02-22T22:16:38.476 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-22T22:16:38.480 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2026-02-22T22:16:38.480 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-22T22:16:38.484 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../067-python3-repoze.lru_0.7-2_all.deb ... 2026-02-22T22:16:38.484 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-22T22:16:38.495 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-portend. 2026-02-22T22:16:38.499 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-routes. 2026-02-22T22:16:38.503 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2026-02-22T22:16:38.503 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-22T22:16:38.507 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../068-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-22T22:16:38.508 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-22T22:16:38.518 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-22T22:16:38.526 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-22T22:16:38.527 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-22T22:16:38.527 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-22T22:16:38.536 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../069-ceph-mgr-dashboard_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T22:16:38.536 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking ceph-mgr-dashboard (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:38.541 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-22T22:16:38.549 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-22T22:16:38.549 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-22T22:16:38.573 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-natsort. 2026-02-22T22:16:38.581 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2026-02-22T22:16:38.581 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-22T22:16:38.597 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-logutils. 2026-02-22T22:16:38.605 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2026-02-22T22:16:38.606 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-logutils (0.3.3-8) ... 2026-02-22T22:16:38.620 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-mako. 2026-02-22T22:16:38.628 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2026-02-22T22:16:38.629 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2026-02-22T22:16:38.647 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-simplegeneric. 2026-02-22T22:16:38.655 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2026-02-22T22:16:38.656 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2026-02-22T22:16:38.670 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-singledispatch. 2026-02-22T22:16:38.678 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2026-02-22T22:16:38.679 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2026-02-22T22:16:38.693 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-webob. 2026-02-22T22:16:38.702 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-22T22:16:38.702 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-22T22:16:38.719 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-waitress. 2026-02-22T22:16:38.727 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1.1_all.deb ... 2026-02-22T22:16:38.729 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1.1) ... 2026-02-22T22:16:38.743 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-22T22:16:38.745 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-tempita. 2026-02-22T22:16:38.752 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-22T22:16:38.753 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-22T22:16:38.753 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2026-02-22T22:16:38.754 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2026-02-22T22:16:38.768 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-paste. 2026-02-22T22:16:38.776 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2026-02-22T22:16:38.777 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2026-02-22T22:16:38.790 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-joblib. 2026-02-22T22:16:38.799 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../071-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-22T22:16:38.800 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-22T22:16:38.804 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2026-02-22T22:16:38.813 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2026-02-22T22:16:38.813 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2026-02-22T22:16:38.825 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-22T22:16:38.827 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-pastedeploy. 2026-02-22T22:16:38.834 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../072-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-22T22:16:38.834 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-22T22:16:38.835 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2026-02-22T22:16:38.835 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2026-02-22T22:16:38.848 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-sklearn. 2026-02-22T22:16:38.851 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-webtest. 2026-02-22T22:16:38.857 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../073-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-22T22:16:38.857 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-22T22:16:38.859 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2026-02-22T22:16:38.860 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-webtest (2.0.35-1) ... 2026-02-22T22:16:38.874 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-pecan. 2026-02-22T22:16:38.882 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2026-02-22T22:16:38.883 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2026-02-22T22:16:38.908 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-werkzeug. 2026-02-22T22:16:38.916 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.3_all.deb ... 2026-02-22T22:16:38.917 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.3) ... 2026-02-22T22:16:38.936 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-22T22:16:38.940 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-22T22:16:38.944 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T22:16:38.945 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-mgr-modules-core (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:38.949 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../074-ceph-mgr-diskprediction-local_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T22:16:38.950 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking ceph-mgr-diskprediction-local (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:38.972 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-22T22:16:38.981 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:38.981 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libsqlite3-mod-ceph (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:38.996 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-mgr. 2026-02-22T22:16:39.005 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../057-ceph-mgr_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:39.005 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-mgr (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:39.027 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-mon. 2026-02-22T22:16:39.035 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../058-ceph-mon_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:39.036 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-mon (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:39.096 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-22T22:16:39.104 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../059-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-22T22:16:39.104 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-22T22:16:39.117 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-cachetools. 2026-02-22T22:16:39.121 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-osd. 2026-02-22T22:16:39.125 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../075-python3-cachetools_5.0.0-1_all.deb ... 2026-02-22T22:16:39.126 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-22T22:16:39.129 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../060-ceph-osd_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:39.130 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-osd (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:39.140 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-rsa. 2026-02-22T22:16:39.148 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../076-python3-rsa_4.8-1_all.deb ... 2026-02-22T22:16:39.149 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-22T22:16:39.166 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-google-auth. 2026-02-22T22:16:39.175 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-3_all.deb ... 2026-02-22T22:16:39.175 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-22T22:16:39.192 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-22T22:16:39.201 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../078-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-22T22:16:39.201 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-22T22:16:39.217 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-websocket. 2026-02-22T22:16:39.225 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../079-python3-websocket_1.2.3-1_all.deb ... 2026-02-22T22:16:39.225 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-22T22:16:39.242 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-22T22:16:39.250 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../080-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-22T22:16:39.251 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-22T22:16:39.282 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph. 2026-02-22T22:16:39.291 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../061-ceph_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:39.291 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:39.305 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-fuse. 2026-02-22T22:16:39.313 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../062-ceph-fuse_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:39.313 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-fuse (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:39.337 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-mds. 2026-02-22T22:16:39.345 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../063-ceph-mds_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:39.346 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-mds (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:39.346 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-22T22:16:39.355 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../081-ceph-mgr-k8sevents_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T22:16:39.356 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking ceph-mgr-k8sevents (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:39.370 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-22T22:16:39.378 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../082-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-22T22:16:39.384 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package cephadm. 2026-02-22T22:16:39.385 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-22T22:16:39.393 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../064-cephadm_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:39.393 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking cephadm (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:39.400 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-22T22:16:39.409 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../083-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-22T22:16:39.410 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-22T22:16:39.410 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-22T22:16:39.417 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-22T22:16:39.417 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-22T22:16:39.424 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package jq. 2026-02-22T22:16:39.433 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../084-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-22T22:16:39.433 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-22T22:16:39.439 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-22T22:16:39.447 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package socat. 2026-02-22T22:16:39.448 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../066-ceph-mgr-cephadm_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T22:16:39.448 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-mgr-cephadm (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:39.455 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../085-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-22T22:16:39.456 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-22T22:16:39.468 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-22T22:16:39.475 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package xmlstarlet. 2026-02-22T22:16:39.475 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../067-python3-repoze.lru_0.7-2_all.deb ... 2026-02-22T22:16:39.476 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-22T22:16:39.483 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-22T22:16:39.484 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-22T22:16:39.490 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-routes. 2026-02-22T22:16:39.498 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../068-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-22T22:16:39.499 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-22T22:16:39.518 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-22T22:16:39.519 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package ceph-test. 2026-02-22T22:16:39.526 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../069-ceph-mgr-dashboard_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T22:16:39.527 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-mgr-dashboard (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:39.528 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../087-ceph-test_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:39.528 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking ceph-test (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:39.734 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-22T22:16:39.743 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-22T22:16:39.743 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-22T22:16:39.781 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-joblib. 2026-02-22T22:16:39.790 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../071-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-22T22:16:39.790 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-22T22:16:39.817 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-22T22:16:39.826 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../072-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-22T22:16:39.826 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-22T22:16:39.841 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-sklearn. 2026-02-22T22:16:39.849 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../073-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-22T22:16:39.850 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-22T22:16:39.932 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-22T22:16:39.941 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../074-ceph-mgr-diskprediction-local_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T22:16:39.942 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-mgr-diskprediction-local (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:40.003 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package ceph-volume. 2026-02-22T22:16:40.012 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../088-ceph-volume_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T22:16:40.013 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking ceph-volume (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:40.035 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-22T22:16:40.044 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../089-libcephfs-dev_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:40.045 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking libcephfs-dev (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:40.059 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package lua-socket:amd64. 2026-02-22T22:16:40.068 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../090-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2026-02-22T22:16:40.069 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2026-02-22T22:16:40.089 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package lua-sec:amd64. 2026-02-22T22:16:40.097 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../091-lua-sec_1.0.2-1_amd64.deb ... 2026-02-22T22:16:40.098 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2026-02-22T22:16:40.106 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-cachetools. 2026-02-22T22:16:40.113 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package nvme-cli. 2026-02-22T22:16:40.114 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../075-python3-cachetools_5.0.0-1_all.deb ... 2026-02-22T22:16:40.115 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-22T22:16:40.122 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../092-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-22T22:16:40.122 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-22T22:16:40.129 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-rsa. 2026-02-22T22:16:40.138 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../076-python3-rsa_4.8-1_all.deb ... 2026-02-22T22:16:40.138 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-22T22:16:40.155 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-google-auth. 2026-02-22T22:16:40.156 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package pkg-config. 2026-02-22T22:16:40.164 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-3_all.deb ... 2026-02-22T22:16:40.165 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-22T22:16:40.165 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../093-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2026-02-22T22:16:40.165 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2026-02-22T22:16:40.181 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-22T22:16:40.182 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-22T22:16:40.190 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../094-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-22T22:16:40.190 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-22T22:16:40.191 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../078-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-22T22:16:40.192 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-22T22:16:40.208 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-websocket. 2026-02-22T22:16:40.216 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../079-python3-websocket_1.2.3-1_all.deb ... 2026-02-22T22:16:40.217 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-22T22:16:40.218 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-22T22:16:40.227 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../095-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-22T22:16:40.228 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-22T22:16:40.235 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-22T22:16:40.242 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-pastescript. 2026-02-22T22:16:40.243 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../080-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-22T22:16:40.244 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-22T22:16:40.250 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../096-python3-pastescript_2.0.2-4_all.deb ... 2026-02-22T22:16:40.251 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2026-02-22T22:16:40.269 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-pluggy. 2026-02-22T22:16:40.277 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../097-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-22T22:16:40.278 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-22T22:16:40.294 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-psutil. 2026-02-22T22:16:40.302 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../098-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-22T22:16:40.302 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-22T22:16:40.320 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-py. 2026-02-22T22:16:40.329 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../099-python3-py_1.10.0-1_all.deb ... 2026-02-22T22:16:40.329 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-22T22:16:40.338 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-22T22:16:40.347 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../081-ceph-mgr-k8sevents_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T22:16:40.347 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-mgr-k8sevents (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:40.349 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-pygments. 2026-02-22T22:16:40.357 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../100-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-22T22:16:40.358 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-22T22:16:40.362 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-22T22:16:40.371 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../082-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-22T22:16:40.378 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-22T22:16:40.394 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-22T22:16:40.398 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-pyinotify. 2026-02-22T22:16:40.402 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../083-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-22T22:16:40.403 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-22T22:16:40.407 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../101-python3-pyinotify_0.9.6-1.3_all.deb ... 2026-02-22T22:16:40.407 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2026-02-22T22:16:40.417 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package jq. 2026-02-22T22:16:40.423 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-toml. 2026-02-22T22:16:40.427 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../084-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-22T22:16:40.427 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-22T22:16:40.431 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../102-python3-toml_0.10.2-1_all.deb ... 2026-02-22T22:16:40.432 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-22T22:16:40.440 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package socat. 2026-02-22T22:16:40.447 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-pytest. 2026-02-22T22:16:40.449 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../085-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-22T22:16:40.449 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-22T22:16:40.455 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../103-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-22T22:16:40.456 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-22T22:16:40.469 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package xmlstarlet. 2026-02-22T22:16:40.477 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package python3-simplejson. 2026-02-22T22:16:40.478 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-22T22:16:40.479 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-22T22:16:40.485 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../104-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-22T22:16:40.486 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-22T22:16:40.502 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-22T22:16:40.511 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../105-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-22T22:16:40.511 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-22T22:16:40.514 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-test. 2026-02-22T22:16:40.523 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../087-ceph-test_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:40.523 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-test (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:40.578 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package radosgw. 2026-02-22T22:16:40.587 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../106-radosgw_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:40.588 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking radosgw (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:40.700 INFO:teuthology.orchestra.run.trial101.stdout:Selecting previously unselected package rbd-fuse. 2026-02-22T22:16:40.709 INFO:teuthology.orchestra.run.trial101.stdout:Preparing to unpack .../107-rbd-fuse_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:40.709 INFO:teuthology.orchestra.run.trial101.stdout:Unpacking rbd-fuse (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:40.737 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-22T22:16:40.803 INFO:teuthology.orchestra.run.trial101.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-22T22:16:40.803 INFO:teuthology.orchestra.run.trial101.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-22T22:16:40.874 INFO:teuthology.orchestra.run.trial101.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-22T22:16:41.001 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package ceph-volume. 2026-02-22T22:16:41.009 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../088-ceph-volume_19.2.3-689-gf90f4eae-1jammy_all.deb ... 2026-02-22T22:16:41.010 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking ceph-volume (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:41.032 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-22T22:16:41.041 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../089-libcephfs-dev_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:41.041 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking libcephfs-dev (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:41.057 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package lua-socket:amd64. 2026-02-22T22:16:41.065 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../090-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2026-02-22T22:16:41.066 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2026-02-22T22:16:41.086 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package lua-sec:amd64. 2026-02-22T22:16:41.095 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../091-lua-sec_1.0.2-1_amd64.deb ... 2026-02-22T22:16:41.095 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2026-02-22T22:16:41.112 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package nvme-cli. 2026-02-22T22:16:41.121 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../092-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-22T22:16:41.121 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-22T22:16:41.154 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package pkg-config. 2026-02-22T22:16:41.154 INFO:teuthology.orchestra.run.trial101.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-22T22:16:41.162 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../093-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2026-02-22T22:16:41.162 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2026-02-22T22:16:41.178 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-22T22:16:41.187 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../094-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-22T22:16:41.187 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-22T22:16:41.216 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-22T22:16:41.225 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../095-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-22T22:16:41.225 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-22T22:16:41.240 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-pastescript. 2026-02-22T22:16:41.249 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../096-python3-pastescript_2.0.2-4_all.deb ... 2026-02-22T22:16:41.249 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2026-02-22T22:16:41.267 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-pluggy. 2026-02-22T22:16:41.276 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../097-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-22T22:16:41.276 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-22T22:16:41.292 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-psutil. 2026-02-22T22:16:41.301 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../098-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-22T22:16:41.301 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-22T22:16:41.320 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-py. 2026-02-22T22:16:41.329 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../099-python3-py_1.10.0-1_all.deb ... 2026-02-22T22:16:41.329 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-22T22:16:41.348 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-pygments. 2026-02-22T22:16:41.357 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../100-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-22T22:16:41.357 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-22T22:16:41.400 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-pyinotify. 2026-02-22T22:16:41.409 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../101-python3-pyinotify_0.9.6-1.3_all.deb ... 2026-02-22T22:16:41.410 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2026-02-22T22:16:41.425 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-toml. 2026-02-22T22:16:41.433 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../102-python3-toml_0.10.2-1_all.deb ... 2026-02-22T22:16:41.434 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-22T22:16:41.449 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-pytest. 2026-02-22T22:16:41.458 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../103-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-22T22:16:41.458 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-22T22:16:41.480 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package python3-simplejson. 2026-02-22T22:16:41.488 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../104-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-22T22:16:41.489 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-22T22:16:41.506 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-22T22:16:41.515 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../105-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-22T22:16:41.515 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-22T22:16:41.551 INFO:teuthology.orchestra.run.trial101.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-22T22:16:41.561 INFO:teuthology.orchestra.run.trial101.stdout:Setting up cephadm (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:41.581 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package radosgw. 2026-02-22T22:16:41.590 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../106-radosgw_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:41.590 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking radosgw (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:41.617 INFO:teuthology.orchestra.run.trial101.stdout:Adding system user cephadm....done 2026-02-22T22:16:41.627 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1.1) ... 2026-02-22T22:16:41.698 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-22T22:16:41.707 INFO:teuthology.orchestra.run.trial061.stdout:Selecting previously unselected package rbd-fuse. 2026-02-22T22:16:41.715 INFO:teuthology.orchestra.run.trial061.stdout:Preparing to unpack .../107-rbd-fuse_19.2.3-689-gf90f4eae-1jammy_amd64.deb ... 2026-02-22T22:16:41.715 INFO:teuthology.orchestra.run.trial061.stdout:Unpacking rbd-fuse (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:41.744 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-22T22:16:41.772 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-22T22:16:41.773 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-22T22:16:41.813 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-22T22:16:41.814 INFO:teuthology.orchestra.run.trial061.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-22T22:16:41.843 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-22T22:16:41.893 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-22T22:16:41.919 INFO:teuthology.orchestra.run.trial101.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-22T22:16:41.920 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-22T22:16:42.014 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-22T22:16:42.134 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-22T22:16:42.162 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-22T22:16:42.210 INFO:teuthology.orchestra.run.trial101.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2026-02-22T22:16:42.223 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2026-02-22T22:16:42.298 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-22T22:16:42.373 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-ceph-argparse (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:42.438 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-22T22:16:42.439 INFO:teuthology.orchestra.run.trial101.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-22T22:16:42.440 INFO:teuthology.orchestra.run.trial101.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2026-02-22T22:16:42.441 INFO:teuthology.orchestra.run.trial101.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2026-02-22T22:16:42.442 INFO:teuthology.orchestra.run.trial101.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-22T22:16:42.443 INFO:teuthology.orchestra.run.trial101.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2026-02-22T22:16:42.459 INFO:teuthology.orchestra.run.trial101.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2026-02-22T22:16:42.461 INFO:teuthology.orchestra.run.trial101.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2026-02-22T22:16:42.462 INFO:teuthology.orchestra.run.trial101.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-22T22:16:42.464 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-22T22:16:42.554 INFO:teuthology.orchestra.run.trial061.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-22T22:16:42.565 INFO:teuthology.orchestra.run.trial061.stdout:Setting up cephadm (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:42.586 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-22T22:16:42.607 INFO:teuthology.orchestra.run.trial061.stdout:Adding system user cephadm....done 2026-02-22T22:16:42.615 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1.1) ... 2026-02-22T22:16:42.665 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-22T22:16:42.689 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-22T22:16:42.746 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-22T22:16:42.761 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-22T22:16:42.762 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-22T22:16:42.833 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-22T22:16:42.835 INFO:teuthology.orchestra.run.trial101.stdout:Setting up zip (3.0-12build2) ... 2026-02-22T22:16:42.836 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-22T22:16:42.908 INFO:teuthology.orchestra.run.trial061.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-22T22:16:42.909 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-22T22:16:43.004 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-22T22:16:43.084 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2026-02-22T22:16:43.128 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-22T22:16:43.160 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2026-02-22T22:16:43.161 INFO:teuthology.orchestra.run.trial101.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-22T22:16:43.162 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-22T22:16:43.203 INFO:teuthology.orchestra.run.trial061.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2026-02-22T22:16:43.214 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2026-02-22T22:16:43.257 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-22T22:16:43.293 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-22T22:16:43.367 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-ceph-argparse (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:43.379 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2026-02-22T22:16:43.436 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-22T22:16:43.437 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-22T22:16:43.438 INFO:teuthology.orchestra.run.trial061.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2026-02-22T22:16:43.438 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2026-02-22T22:16:43.439 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-22T22:16:43.440 INFO:teuthology.orchestra.run.trial061.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2026-02-22T22:16:43.457 INFO:teuthology.orchestra.run.trial061.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2026-02-22T22:16:43.459 INFO:teuthology.orchestra.run.trial061.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2026-02-22T22:16:43.460 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-22T22:16:43.461 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-22T22:16:43.508 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-22T22:16:43.587 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-22T22:16:43.588 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.3) ... 2026-02-22T22:16:43.666 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-22T22:16:43.693 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-22T22:16:43.749 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-22T22:16:43.765 INFO:teuthology.orchestra.run.trial101.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-22T22:16:43.765 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-ceph-common (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:43.839 INFO:teuthology.orchestra.run.trial061.stdout:Setting up zip (3.0-12build2) ... 2026-02-22T22:16:43.840 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-22T22:16:43.849 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-22T22:16:44.098 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2026-02-22T22:16:44.173 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2026-02-22T22:16:44.174 INFO:teuthology.orchestra.run.trial061.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-22T22:16:44.175 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-22T22:16:44.271 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-22T22:16:44.350 INFO:teuthology.orchestra.run.trial101.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2026-02-22T22:16:44.372 INFO:teuthology.orchestra.run.trial101.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T22:16:44.377 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-22T22:16:44.397 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2026-02-22T22:16:44.452 INFO:teuthology.orchestra.run.trial101.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-22T22:16:44.453 INFO:teuthology.orchestra.run.trial101.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-22T22:16:44.454 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-22T22:16:44.527 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-22T22:16:44.530 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-22T22:16:44.604 INFO:teuthology.orchestra.run.trial101.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T22:16:44.605 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-22T22:16:44.608 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.3) ... 2026-02-22T22:16:44.682 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2026-02-22T22:16:44.714 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-22T22:16:44.758 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-logutils (0.3.3-8) ... 2026-02-22T22:16:44.789 INFO:teuthology.orchestra.run.trial061.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-22T22:16:44.790 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-ceph-common (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:44.836 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-22T22:16:44.872 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-22T22:16:44.914 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2026-02-22T22:16:44.983 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-22T22:16:45.062 INFO:teuthology.orchestra.run.trial101.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-22T22:16:45.063 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-22T22:16:45.147 INFO:teuthology.orchestra.run.trial101.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-22T22:16:45.148 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-22T22:16:45.224 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2026-02-22T22:16:45.302 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-22T22:16:45.380 INFO:teuthology.orchestra.run.trial061.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2026-02-22T22:16:45.387 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-22T22:16:45.402 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T22:16:45.407 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-22T22:16:45.461 INFO:teuthology.orchestra.run.trial101.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2026-02-22T22:16:45.462 INFO:teuthology.orchestra.run.trial101.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2026-02-22T22:16:45.463 INFO:teuthology.orchestra.run.trial101.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-22T22:16:45.464 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-22T22:16:45.487 INFO:teuthology.orchestra.run.trial061.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-22T22:16:45.489 INFO:teuthology.orchestra.run.trial061.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-22T22:16:45.490 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-22T22:16:45.566 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-22T22:16:45.600 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2026-02-22T22:16:45.637 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T22:16:45.638 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-22T22:16:45.676 INFO:teuthology.orchestra.run.trial101.stdout:Setting up lua-any (27ubuntu1) ... 2026-02-22T22:16:45.677 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-22T22:16:45.716 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2026-02-22T22:16:45.752 INFO:teuthology.orchestra.run.trial101.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T22:16:45.753 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-22T22:16:45.789 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-logutils (0.3.3-8) ... 2026-02-22T22:16:45.834 INFO:teuthology.orchestra.run.trial101.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-22T22:16:45.835 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-webtest (2.0.35-1) ... 2026-02-22T22:16:45.867 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-22T22:16:45.915 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-22T22:16:45.943 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2026-02-22T22:16:46.018 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-22T22:16:46.049 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-pastescript (2.0.2-4) ... 2026-02-22T22:16:46.096 INFO:teuthology.orchestra.run.trial061.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-22T22:16:46.097 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-22T22:16:46.135 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2026-02-22T22:16:46.180 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-22T22:16:46.181 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-22T22:16:46.248 INFO:teuthology.orchestra.run.trial101.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-22T22:16:46.249 INFO:teuthology.orchestra.run.trial101.stdout:Setting up librados2 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:46.250 INFO:teuthology.orchestra.run.trial101.stdout:Setting up libsqlite3-mod-ceph (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:46.251 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-22T22:16:46.261 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2026-02-22T22:16:46.340 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-22T22:16:46.426 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-22T22:16:46.501 INFO:teuthology.orchestra.run.trial061.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2026-02-22T22:16:46.502 INFO:teuthology.orchestra.run.trial061.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2026-02-22T22:16:46.503 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-22T22:16:46.504 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-22T22:16:46.646 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2026-02-22T22:16:46.721 INFO:teuthology.orchestra.run.trial061.stdout:Setting up lua-any (27ubuntu1) ... 2026-02-22T22:16:46.722 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-22T22:16:46.769 INFO:teuthology.orchestra.run.trial101.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2026-02-22T22:16:46.781 INFO:teuthology.orchestra.run.trial101.stdout:Setting up libcephfs2 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:46.781 INFO:teuthology.orchestra.run.trial101.stdout:Setting up libradosstriper1 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:46.782 INFO:teuthology.orchestra.run.trial101.stdout:Setting up librbd1 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:46.783 INFO:teuthology.orchestra.run.trial101.stdout:Setting up ceph-mgr-modules-core (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:46.784 INFO:teuthology.orchestra.run.trial101.stdout:Setting up ceph-fuse (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:46.794 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-22T22:16:46.795 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-22T22:16:46.850 INFO:teuthology.orchestra.run.trial101.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-22T22:16:46.851 INFO:teuthology.orchestra.run.trial101.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-22T22:16:46.879 INFO:teuthology.orchestra.run.trial061.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-22T22:16:46.880 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-webtest (2.0.35-1) ... 2026-02-22T22:16:46.962 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-22T22:16:47.096 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-pastescript (2.0.2-4) ... 2026-02-22T22:16:47.189 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2026-02-22T22:16:47.268 INFO:teuthology.orchestra.run.trial101.stdout:Setting up libcephfs-dev (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:47.269 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-rados (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:47.270 INFO:teuthology.orchestra.run.trial101.stdout:Setting up librgw2 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:47.271 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-rbd (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:47.271 INFO:teuthology.orchestra.run.trial101.stdout:Setting up rbd-fuse (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:47.272 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-rgw (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:47.273 INFO:teuthology.orchestra.run.trial101.stdout:Setting up python3-cephfs (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:47.274 INFO:teuthology.orchestra.run.trial101.stdout:Setting up ceph-common (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:47.303 INFO:teuthology.orchestra.run.trial101.stdout:Adding group ceph....done 2026-02-22T22:16:47.304 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-22T22:16:47.304 INFO:teuthology.orchestra.run.trial061.stdout:Setting up librados2 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:47.305 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libsqlite3-mod-ceph (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:47.306 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-22T22:16:47.339 INFO:teuthology.orchestra.run.trial101.stdout:Adding system user ceph....done 2026-02-22T22:16:47.349 INFO:teuthology.orchestra.run.trial101.stdout:Setting system user ceph properties....done 2026-02-22T22:16:47.355 INFO:teuthology.orchestra.run.trial101.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-22T22:16:47.442 INFO:teuthology.orchestra.run.trial101.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-22T22:16:47.710 INFO:teuthology.orchestra.run.trial101.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-22T22:16:47.834 INFO:teuthology.orchestra.run.trial061.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2026-02-22T22:16:47.845 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libcephfs2 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:47.846 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libradosstriper1 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:47.846 INFO:teuthology.orchestra.run.trial061.stdout:Setting up librbd1 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:47.847 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-mgr-modules-core (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:47.848 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-fuse (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:47.922 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-22T22:16:47.922 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-22T22:16:48.111 INFO:teuthology.orchestra.run.trial101.stdout:Setting up ceph-test (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:48.111 INFO:teuthology.orchestra.run.trial101.stdout:Setting up radosgw (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:48.335 INFO:teuthology.orchestra.run.trial061.stdout:Setting up libcephfs-dev (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:48.336 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-rados (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:48.336 INFO:teuthology.orchestra.run.trial061.stdout:Setting up librgw2 (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:48.337 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-rbd (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:48.338 INFO:teuthology.orchestra.run.trial061.stdout:Setting up rbd-fuse (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:48.339 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-rgw (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:48.340 INFO:teuthology.orchestra.run.trial061.stdout:Setting up python3-cephfs (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:48.341 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-common (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:48.369 INFO:teuthology.orchestra.run.trial061.stdout:Adding group ceph....done 2026-02-22T22:16:48.378 INFO:teuthology.orchestra.run.trial101.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-22T22:16:48.378 INFO:teuthology.orchestra.run.trial101.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-22T22:16:48.405 INFO:teuthology.orchestra.run.trial061.stdout:Adding system user ceph....done 2026-02-22T22:16:48.415 INFO:teuthology.orchestra.run.trial061.stdout:Setting system user ceph properties....done 2026-02-22T22:16:48.420 INFO:teuthology.orchestra.run.trial061.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-22T22:16:48.507 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-22T22:16:48.750 INFO:teuthology.orchestra.run.trial101.stdout:Setting up ceph-base (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:48.778 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-22T22:16:48.869 INFO:teuthology.orchestra.run.trial101.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-22T22:16:49.189 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-test (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:49.190 INFO:teuthology.orchestra.run.trial061.stdout:Setting up radosgw (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:49.250 INFO:teuthology.orchestra.run.trial101.stdout:Setting up ceph-mds (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:49.309 INFO:teuthology.orchestra.run.trial101.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-22T22:16:49.310 INFO:teuthology.orchestra.run.trial101.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-22T22:16:49.446 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-22T22:16:49.446 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-22T22:16:49.697 INFO:teuthology.orchestra.run.trial101.stdout:Setting up ceph-mgr (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:49.775 INFO:teuthology.orchestra.run.trial101.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-22T22:16:49.775 INFO:teuthology.orchestra.run.trial101.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-22T22:16:49.825 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-base (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:49.934 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-22T22:16:50.145 INFO:teuthology.orchestra.run.trial101.stdout:Setting up ceph-osd (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:50.229 INFO:teuthology.orchestra.run.trial101.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-22T22:16:50.229 INFO:teuthology.orchestra.run.trial101.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-22T22:16:50.324 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-mds (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:50.383 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-22T22:16:50.383 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-22T22:16:50.598 INFO:teuthology.orchestra.run.trial101.stdout:Setting up ceph-mgr-k8sevents (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:50.599 INFO:teuthology.orchestra.run.trial101.stdout:Setting up ceph-mgr-diskprediction-local (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:50.608 INFO:teuthology.orchestra.run.trial101.stdout:Setting up ceph-mon (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:50.680 INFO:teuthology.orchestra.run.trial101.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-22T22:16:50.680 INFO:teuthology.orchestra.run.trial101.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-22T22:16:50.751 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-mgr (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:50.813 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-22T22:16:50.813 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-22T22:16:51.045 INFO:teuthology.orchestra.run.trial101.stdout:Setting up ceph-mgr-cephadm (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:51.057 INFO:teuthology.orchestra.run.trial101.stdout:Setting up ceph (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:51.059 INFO:teuthology.orchestra.run.trial101.stdout:Setting up ceph-mgr-dashboard (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:51.069 INFO:teuthology.orchestra.run.trial101.stdout:Setting up ceph-volume (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:51.178 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-osd (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:51.178 INFO:teuthology.orchestra.run.trial101.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2026-02-22T22:16:51.186 INFO:teuthology.orchestra.run.trial101.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.13) ... 2026-02-22T22:16:51.260 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-22T22:16:51.260 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-22T22:16:51.429 INFO:teuthology.orchestra.run.trial101.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-22T22:16:51.513 INFO:teuthology.orchestra.run.trial101.stdout:Processing triggers for install-info (6.8-4build1) ... 2026-02-22T22:16:51.665 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-mgr-k8sevents (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:51.665 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-mgr-diskprediction-local (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:51.676 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-mon (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:51.750 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-22T22:16:51.751 INFO:teuthology.orchestra.run.trial061.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-22T22:16:51.994 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:51.994 INFO:teuthology.orchestra.run.trial101.stdout:Running kernel seems to be up-to-date. 2026-02-22T22:16:51.995 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:51.995 INFO:teuthology.orchestra.run.trial101.stdout:The processor microcode seems to be up-to-date. 2026-02-22T22:16:51.995 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:51.995 INFO:teuthology.orchestra.run.trial101.stdout:No services need to be restarted. 2026-02-22T22:16:51.995 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:51.995 INFO:teuthology.orchestra.run.trial101.stdout:No containers need to be restarted. 2026-02-22T22:16:51.995 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:51.995 INFO:teuthology.orchestra.run.trial101.stdout:No user sessions are running outdated binaries. 2026-02-22T22:16:51.995 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:51.995 INFO:teuthology.orchestra.run.trial101.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-22T22:16:52.131 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-mgr-cephadm (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:52.143 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:52.144 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-mgr-dashboard (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:52.154 INFO:teuthology.orchestra.run.trial061.stdout:Setting up ceph-volume (19.2.3-689-gf90f4eae-1jammy) ... 2026-02-22T22:16:52.268 INFO:teuthology.orchestra.run.trial061.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2026-02-22T22:16:52.276 INFO:teuthology.orchestra.run.trial061.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.13) ... 2026-02-22T22:16:52.519 INFO:teuthology.orchestra.run.trial061.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-22T22:16:52.605 INFO:teuthology.orchestra.run.trial061.stdout:Processing triggers for install-info (6.8-4build1) ... 2026-02-22T22:16:52.815 INFO:teuthology.orchestra.run.trial101.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-22T22:16:52.822 DEBUG:teuthology.parallel:result is None 2026-02-22T22:16:53.107 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:53.107 INFO:teuthology.orchestra.run.trial061.stdout:Running kernel seems to be up-to-date. 2026-02-22T22:16:53.107 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:53.107 INFO:teuthology.orchestra.run.trial061.stdout:The processor microcode seems to be up-to-date. 2026-02-22T22:16:53.107 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:53.107 INFO:teuthology.orchestra.run.trial061.stdout:No services need to be restarted. 2026-02-22T22:16:53.108 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:53.108 INFO:teuthology.orchestra.run.trial061.stdout:No containers need to be restarted. 2026-02-22T22:16:53.108 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:53.108 INFO:teuthology.orchestra.run.trial061.stdout:No user sessions are running outdated binaries. 2026-02-22T22:16:53.108 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:53.108 INFO:teuthology.orchestra.run.trial061.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-22T22:16:53.932 INFO:teuthology.orchestra.run.trial061.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-22T22:16:53.939 DEBUG:teuthology.parallel:result is None 2026-02-22T22:16:53.939 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T22:16:54.105 DEBUG:teuthology.orchestra.run.trial061:> dpkg-query -W -f '${Version}' ceph 2026-02-22T22:16:54.117 INFO:teuthology.orchestra.run.trial061.stdout:19.2.3-689-gf90f4eae-1jammy 2026-02-22T22:16:54.118 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-689-gf90f4eae-1jammy 2026-02-22T22:16:54.118 INFO:teuthology.task.install:The correct ceph version 19.2.3-689-gf90f4eae-1jammy is installed. 2026-02-22T22:16:54.121 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f90f4eaebb28b619cf76e80cbbe997656da69579 2026-02-22T22:16:54.272 DEBUG:teuthology.orchestra.run.trial101:> dpkg-query -W -f '${Version}' ceph 2026-02-22T22:16:54.283 INFO:teuthology.orchestra.run.trial101.stdout:19.2.3-689-gf90f4eae-1jammy 2026-02-22T22:16:54.284 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-689-gf90f4eae-1jammy 2026-02-22T22:16:54.284 INFO:teuthology.task.install:The correct ceph version 19.2.3-689-gf90f4eae-1jammy is installed. 2026-02-22T22:16:54.286 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-22T22:16:54.286 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T22:16:54.286 DEBUG:teuthology.orchestra.run.trial061:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-22T22:16:54.297 DEBUG:teuthology.orchestra.run.trial101:> set -ex 2026-02-22T22:16:54.297 DEBUG:teuthology.orchestra.run.trial101:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-22T22:16:54.340 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-22T22:16:54.340 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T22:16:54.340 DEBUG:teuthology.orchestra.run.trial061:> sudo dd of=/usr/bin/daemon-helper 2026-02-22T22:16:54.349 DEBUG:teuthology.orchestra.run.trial061:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-22T22:16:54.399 DEBUG:teuthology.orchestra.run.trial101:> set -ex 2026-02-22T22:16:54.400 DEBUG:teuthology.orchestra.run.trial101:> sudo dd of=/usr/bin/daemon-helper 2026-02-22T22:16:54.408 DEBUG:teuthology.orchestra.run.trial101:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-22T22:16:54.458 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-22T22:16:54.458 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T22:16:54.458 DEBUG:teuthology.orchestra.run.trial061:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-22T22:16:54.468 DEBUG:teuthology.orchestra.run.trial061:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-22T22:16:54.519 DEBUG:teuthology.orchestra.run.trial101:> set -ex 2026-02-22T22:16:54.520 DEBUG:teuthology.orchestra.run.trial101:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-22T22:16:54.528 DEBUG:teuthology.orchestra.run.trial101:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-22T22:16:54.582 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-22T22:16:54.582 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T22:16:54.583 DEBUG:teuthology.orchestra.run.trial061:> sudo dd of=/usr/bin/stdin-killer 2026-02-22T22:16:54.592 DEBUG:teuthology.orchestra.run.trial061:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-22T22:16:54.643 DEBUG:teuthology.orchestra.run.trial101:> set -ex 2026-02-22T22:16:54.644 DEBUG:teuthology.orchestra.run.trial101:> sudo dd of=/usr/bin/stdin-killer 2026-02-22T22:16:54.655 DEBUG:teuthology.orchestra.run.trial101:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-22T22:16:54.710 INFO:teuthology.run_tasks:Running task ceph... 2026-02-22T22:16:54.824 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-22T22:16:54.824 DEBUG:teuthology.orchestra.run.trial061:> sudo chmod 777 /var/log/ceph 2026-02-22T22:16:54.825 DEBUG:teuthology.orchestra.run.trial101:> sudo chmod 777 /var/log/ceph 2026-02-22T22:16:54.834 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-22T22:16:54.834 DEBUG:teuthology.orchestra.run.trial061:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-22T22:16:54.876 DEBUG:teuthology.orchestra.run.trial101:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-22T22:16:54.884 INFO:tasks.ceph:Creating extra log directories... 2026-02-22T22:16:54.884 DEBUG:teuthology.orchestra.run.trial061:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-22T22:16:54.925 DEBUG:teuthology.orchestra.run.trial101:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-22T22:16:54.952 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-22T22:16:54.952 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on degraded': True, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd max scrubs': 1, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon election default strategy': 3, 'ms type': 'async', 'osd debug inject dispatch delay duration': 0.1, 'osd debug inject dispatch delay probability': 0.1, 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_object_clean_region_max_num_intervals': 1000, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', '\\(POOL_APP_NOT_ENABLED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-22T22:16:54.952 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64197', 'branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'description': 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench-high-concurrency}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '64197', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'trial', 'name': 'yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri6-testing-2026-02-22-1629-squid'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon election default strategy': 3, 'ms type': 'async', 'osd debug inject dispatch delay duration': 0.1, 'osd debug inject dispatch delay probability': 0.1, 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_object_clean_region_max_num_intervals': 1000, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on degraded': True, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd max scrubs': 1, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', '\\(POOL_APP_NOT_ENABLED\\)'], 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5, 'min_in': 4}, 'workunit': {'branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579'}}, 'owner': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 5907, 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri6-testing-2026-02-22-1629-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f90f4eaebb28b619cf76e80cbbe997656da69579/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'targets': {'trial061.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHHQ+WkraR0IwPZAdjIaSU/Pw/XvOednL/Gi6daK0Dd4YfsvhLcAOQw+2DdNKiGnr2v1spZ0XKgx8JPsWA/jAI4=', 'trial101.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBoIfp7FVbhAEijh+wlebh9rLA+ev88m83ylluZo96gMZlZuRu++KQLXXdiJhRiVtYbbRIvlaTwPlxHTrzOaPqI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on degraded': True, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd max scrubs': 1, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon election default strategy': 3, 'ms type': 'async', 'osd debug inject dispatch delay duration': 0.1, 'osd debug inject dispatch delay probability': 0.1, 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_object_clean_region_max_num_intervals': 1000, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', '\\(POOL_APP_NOT_ENABLED\\)'], 'sha1': 'f90f4eaebb28b619cf76e80cbbe997656da69579', 'cluster': 'ceph'}}, {'exec': {'mon.a': ['ceph config set mgr mgr/balancer/log_level debug', 'ceph balancer status', 'ceph osd set-require-min-compat-client reef', 'ceph balancer mode read', 'ceph balancer on', 'ceph balancer status', 'ceph balancer status detail']}}, {'full_sequential': [{'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}]}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-22_19:35:40', 'tube': 'trial', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653'} 2026-02-22T22:16:54.953 DEBUG:teuthology.orchestra.run.trial061:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-22T22:16:54.977 DEBUG:teuthology.orchestra.run.trial101:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-22T22:16:54.982 DEBUG:teuthology.orchestra.run.trial061:> sudo install -d -m0777 -- /var/run/ceph 2026-02-22T22:16:55.021 DEBUG:teuthology.orchestra.run.trial101:> sudo install -d -m0777 -- /var/run/ceph 2026-02-22T22:16:55.030 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T22:16:55.030 DEBUG:teuthology.orchestra.run.trial061:> dd if=/scratch_devs of=/dev/stdout 2026-02-22T22:16:55.076 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-22T22:16:55.076 DEBUG:teuthology.orchestra.run.trial061:> stat /dev/vg_nvme/lv_1 2026-02-22T22:16:55.123 INFO:teuthology.orchestra.run.trial061.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-22T22:16:55.123 INFO:teuthology.orchestra.run.trial061.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T22:16:55.124 INFO:teuthology.orchestra.run.trial061.stdout:Device: 5h/5d Inode: 907 Links: 1 2026-02-22T22:16:55.124 INFO:teuthology.orchestra.run.trial061.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T22:16:55.124 INFO:teuthology.orchestra.run.trial061.stdout:Access: 2026-02-22 22:16:05.583510009 +0000 2026-02-22T22:16:55.124 INFO:teuthology.orchestra.run.trial061.stdout:Modify: 2026-02-22 22:16:05.411512938 +0000 2026-02-22T22:16:55.124 INFO:teuthology.orchestra.run.trial061.stdout:Change: 2026-02-22 22:16:05.411512938 +0000 2026-02-22T22:16:55.124 INFO:teuthology.orchestra.run.trial061.stdout: Birth: - 2026-02-22T22:16:55.124 DEBUG:teuthology.orchestra.run.trial061:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-22T22:16:55.170 INFO:teuthology.orchestra.run.trial061.stderr:1+0 records in 2026-02-22T22:16:55.171 INFO:teuthology.orchestra.run.trial061.stderr:1+0 records out 2026-02-22T22:16:55.171 INFO:teuthology.orchestra.run.trial061.stderr:512 bytes copied, 0.000191555 s, 2.7 MB/s 2026-02-22T22:16:55.172 DEBUG:teuthology.orchestra.run.trial061:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-22T22:16:55.221 DEBUG:teuthology.orchestra.run.trial061:> stat /dev/vg_nvme/lv_2 2026-02-22T22:16:55.267 INFO:teuthology.orchestra.run.trial061.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-22T22:16:55.267 INFO:teuthology.orchestra.run.trial061.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T22:16:55.268 INFO:teuthology.orchestra.run.trial061.stdout:Device: 5h/5d Inode: 942 Links: 1 2026-02-22T22:16:55.268 INFO:teuthology.orchestra.run.trial061.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T22:16:55.268 INFO:teuthology.orchestra.run.trial061.stdout:Access: 2026-02-22 22:16:05.963503534 +0000 2026-02-22T22:16:55.268 INFO:teuthology.orchestra.run.trial061.stdout:Modify: 2026-02-22 22:16:05.751507145 +0000 2026-02-22T22:16:55.268 INFO:teuthology.orchestra.run.trial061.stdout:Change: 2026-02-22 22:16:05.751507145 +0000 2026-02-22T22:16:55.268 INFO:teuthology.orchestra.run.trial061.stdout: Birth: - 2026-02-22T22:16:55.268 DEBUG:teuthology.orchestra.run.trial061:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-22T22:16:55.314 INFO:teuthology.orchestra.run.trial061.stderr:1+0 records in 2026-02-22T22:16:55.315 INFO:teuthology.orchestra.run.trial061.stderr:1+0 records out 2026-02-22T22:16:55.315 INFO:teuthology.orchestra.run.trial061.stderr:512 bytes copied, 0.000166118 s, 3.1 MB/s 2026-02-22T22:16:55.316 DEBUG:teuthology.orchestra.run.trial061:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-22T22:16:55.365 DEBUG:teuthology.orchestra.run.trial061:> stat /dev/vg_nvme/lv_3 2026-02-22T22:16:55.411 INFO:teuthology.orchestra.run.trial061.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-22T22:16:55.412 INFO:teuthology.orchestra.run.trial061.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T22:16:55.412 INFO:teuthology.orchestra.run.trial061.stdout:Device: 5h/5d Inode: 965 Links: 1 2026-02-22T22:16:55.412 INFO:teuthology.orchestra.run.trial061.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T22:16:55.412 INFO:teuthology.orchestra.run.trial061.stdout:Access: 2026-02-22 22:16:06.119500878 +0000 2026-02-22T22:16:55.412 INFO:teuthology.orchestra.run.trial061.stdout:Modify: 2026-02-22 22:16:06.115500944 +0000 2026-02-22T22:16:55.412 INFO:teuthology.orchestra.run.trial061.stdout:Change: 2026-02-22 22:16:06.115500944 +0000 2026-02-22T22:16:55.412 INFO:teuthology.orchestra.run.trial061.stdout: Birth: - 2026-02-22T22:16:55.413 DEBUG:teuthology.orchestra.run.trial061:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-22T22:16:55.462 INFO:teuthology.orchestra.run.trial061.stderr:1+0 records in 2026-02-22T22:16:55.463 INFO:teuthology.orchestra.run.trial061.stderr:1+0 records out 2026-02-22T22:16:55.463 INFO:teuthology.orchestra.run.trial061.stderr:512 bytes copied, 0.000187628 s, 2.7 MB/s 2026-02-22T22:16:55.464 DEBUG:teuthology.orchestra.run.trial061:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-22T22:16:55.512 DEBUG:teuthology.orchestra.run.trial061:> stat /dev/vg_nvme/lv_4 2026-02-22T22:16:55.559 INFO:teuthology.orchestra.run.trial061.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-22T22:16:55.560 INFO:teuthology.orchestra.run.trial061.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T22:16:55.560 INFO:teuthology.orchestra.run.trial061.stdout:Device: 5h/5d Inode: 979 Links: 1 2026-02-22T22:16:55.560 INFO:teuthology.orchestra.run.trial061.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T22:16:55.560 INFO:teuthology.orchestra.run.trial061.stdout:Access: 2026-02-22 22:16:06.639492017 +0000 2026-02-22T22:16:55.560 INFO:teuthology.orchestra.run.trial061.stdout:Modify: 2026-02-22 22:16:06.455495154 +0000 2026-02-22T22:16:55.560 INFO:teuthology.orchestra.run.trial061.stdout:Change: 2026-02-22 22:16:06.455495154 +0000 2026-02-22T22:16:55.560 INFO:teuthology.orchestra.run.trial061.stdout: Birth: - 2026-02-22T22:16:55.561 DEBUG:teuthology.orchestra.run.trial061:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-22T22:16:55.611 INFO:teuthology.orchestra.run.trial061.stderr:1+0 records in 2026-02-22T22:16:55.611 INFO:teuthology.orchestra.run.trial061.stderr:1+0 records out 2026-02-22T22:16:55.611 INFO:teuthology.orchestra.run.trial061.stderr:512 bytes copied, 0.000175787 s, 2.9 MB/s 2026-02-22T22:16:55.612 DEBUG:teuthology.orchestra.run.trial061:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-22T22:16:55.660 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-22T22:16:55.660 DEBUG:teuthology.orchestra.run.trial101:> set -ex 2026-02-22T22:16:55.660 DEBUG:teuthology.orchestra.run.trial101:> dd if=/scratch_devs of=/dev/stdout 2026-02-22T22:16:55.664 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-22T22:16:55.664 DEBUG:teuthology.orchestra.run.trial101:> stat /dev/vg_nvme/lv_1 2026-02-22T22:16:55.711 INFO:teuthology.orchestra.run.trial101.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-22T22:16:55.711 INFO:teuthology.orchestra.run.trial101.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T22:16:55.711 INFO:teuthology.orchestra.run.trial101.stdout:Device: 5h/5d Inode: 906 Links: 1 2026-02-22T22:16:55.711 INFO:teuthology.orchestra.run.trial101.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T22:16:55.711 INFO:teuthology.orchestra.run.trial101.stdout:Access: 2026-02-22 22:16:05.475287066 +0000 2026-02-22T22:16:55.711 INFO:teuthology.orchestra.run.trial101.stdout:Modify: 2026-02-22 22:16:05.307289929 +0000 2026-02-22T22:16:55.711 INFO:teuthology.orchestra.run.trial101.stdout:Change: 2026-02-22 22:16:05.307289929 +0000 2026-02-22T22:16:55.711 INFO:teuthology.orchestra.run.trial101.stdout: Birth: - 2026-02-22T22:16:55.712 DEBUG:teuthology.orchestra.run.trial101:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-22T22:16:55.763 INFO:teuthology.orchestra.run.trial101.stderr:1+0 records in 2026-02-22T22:16:55.763 INFO:teuthology.orchestra.run.trial101.stderr:1+0 records out 2026-02-22T22:16:55.763 INFO:teuthology.orchestra.run.trial101.stderr:512 bytes copied, 0.000195423 s, 2.6 MB/s 2026-02-22T22:16:55.765 DEBUG:teuthology.orchestra.run.trial101:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-22T22:16:55.812 DEBUG:teuthology.orchestra.run.trial101:> stat /dev/vg_nvme/lv_2 2026-02-22T22:16:55.858 INFO:teuthology.orchestra.run.trial101.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-22T22:16:55.859 INFO:teuthology.orchestra.run.trial101.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T22:16:55.859 INFO:teuthology.orchestra.run.trial101.stdout:Device: 5h/5d Inode: 928 Links: 1 2026-02-22T22:16:55.859 INFO:teuthology.orchestra.run.trial101.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T22:16:55.859 INFO:teuthology.orchestra.run.trial101.stdout:Access: 2026-02-22 22:16:05.787281751 +0000 2026-02-22T22:16:55.859 INFO:teuthology.orchestra.run.trial101.stdout:Modify: 2026-02-22 22:16:05.623284545 +0000 2026-02-22T22:16:55.859 INFO:teuthology.orchestra.run.trial101.stdout:Change: 2026-02-22 22:16:05.623284545 +0000 2026-02-22T22:16:55.859 INFO:teuthology.orchestra.run.trial101.stdout: Birth: - 2026-02-22T22:16:55.860 DEBUG:teuthology.orchestra.run.trial101:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-22T22:16:55.909 INFO:teuthology.orchestra.run.trial101.stderr:1+0 records in 2026-02-22T22:16:55.909 INFO:teuthology.orchestra.run.trial101.stderr:1+0 records out 2026-02-22T22:16:55.909 INFO:teuthology.orchestra.run.trial101.stderr:512 bytes copied, 0.000175506 s, 2.9 MB/s 2026-02-22T22:16:55.909 DEBUG:teuthology.orchestra.run.trial101:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-22T22:16:55.955 DEBUG:teuthology.orchestra.run.trial101:> stat /dev/vg_nvme/lv_3 2026-02-22T22:16:56.002 INFO:teuthology.orchestra.run.trial101.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-22T22:16:56.002 INFO:teuthology.orchestra.run.trial101.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T22:16:56.002 INFO:teuthology.orchestra.run.trial101.stdout:Device: 5h/5d Inode: 953 Links: 1 2026-02-22T22:16:56.002 INFO:teuthology.orchestra.run.trial101.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T22:16:56.002 INFO:teuthology.orchestra.run.trial101.stdout:Access: 2026-02-22 22:16:06.135275825 +0000 2026-02-22T22:16:56.002 INFO:teuthology.orchestra.run.trial101.stdout:Modify: 2026-02-22 22:16:05.943279096 +0000 2026-02-22T22:16:56.002 INFO:teuthology.orchestra.run.trial101.stdout:Change: 2026-02-22 22:16:05.943279096 +0000 2026-02-22T22:16:56.002 INFO:teuthology.orchestra.run.trial101.stdout: Birth: - 2026-02-22T22:16:56.002 DEBUG:teuthology.orchestra.run.trial101:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-22T22:16:56.049 INFO:teuthology.orchestra.run.trial101.stderr:1+0 records in 2026-02-22T22:16:56.050 INFO:teuthology.orchestra.run.trial101.stderr:1+0 records out 2026-02-22T22:16:56.050 INFO:teuthology.orchestra.run.trial101.stderr:512 bytes copied, 0.000188891 s, 2.7 MB/s 2026-02-22T22:16:56.051 DEBUG:teuthology.orchestra.run.trial101:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-22T22:16:56.100 DEBUG:teuthology.orchestra.run.trial101:> stat /dev/vg_nvme/lv_4 2026-02-22T22:16:56.146 INFO:teuthology.orchestra.run.trial101.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-22T22:16:56.146 INFO:teuthology.orchestra.run.trial101.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-22T22:16:56.146 INFO:teuthology.orchestra.run.trial101.stdout:Device: 5h/5d Inode: 979 Links: 1 2026-02-22T22:16:56.146 INFO:teuthology.orchestra.run.trial101.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-22T22:16:56.147 INFO:teuthology.orchestra.run.trial101.stdout:Access: 2026-02-22 22:16:06.459270306 +0000 2026-02-22T22:16:56.147 INFO:teuthology.orchestra.run.trial101.stdout:Modify: 2026-02-22 22:16:06.299273030 +0000 2026-02-22T22:16:56.147 INFO:teuthology.orchestra.run.trial101.stdout:Change: 2026-02-22 22:16:06.299273030 +0000 2026-02-22T22:16:56.147 INFO:teuthology.orchestra.run.trial101.stdout: Birth: - 2026-02-22T22:16:56.147 DEBUG:teuthology.orchestra.run.trial101:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-22T22:16:56.193 INFO:teuthology.orchestra.run.trial101.stderr:1+0 records in 2026-02-22T22:16:56.193 INFO:teuthology.orchestra.run.trial101.stderr:1+0 records out 2026-02-22T22:16:56.193 INFO:teuthology.orchestra.run.trial101.stderr:512 bytes copied, 0.000180265 s, 2.8 MB/s 2026-02-22T22:16:56.195 DEBUG:teuthology.orchestra.run.trial101:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-22T22:16:56.244 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2026-02-22T22:16:56.244 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial061.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial101.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2026-02-22T22:16:56.244 INFO:tasks.ceph:Generating config... 2026-02-22T22:16:56.246 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-22T22:16:56.247 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-22T22:16:56.247 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-22T22:16:56.247 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-22T22:16:56.247 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-22T22:16:56.247 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-22T22:16:56.247 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-22T22:16:56.247 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-22T22:16:56.247 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-22T22:16:56.247 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-22T22:16:56.247 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-22T22:16:56.248 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-22T22:16:56.248 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-22T22:16:56.248 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-22T22:16:56.248 INFO:tasks.ceph:[osd] osd backoff on degraded = True 2026-02-22T22:16:56.248 INFO:tasks.ceph:[osd] osd backoff on peering = True 2026-02-22T22:16:56.248 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2026-02-22T22:16:56.248 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-22T22:16:56.248 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-22T22:16:56.248 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-22T22:16:56.248 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2026-02-22T22:16:56.248 INFO:tasks.ceph:[osd] osd max scrubs = 1 2026-02-22T22:16:56.248 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-22T22:16:56.248 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-22T22:16:56.249 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-22T22:16:56.249 INFO:tasks.ceph:[osd] osd memory target = 1610612736 2026-02-22T22:16:56.249 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-22T22:16:56.249 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-22T22:16:56.249 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-22T22:16:56.249 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-22T22:16:56.249 INFO:tasks.ceph:[client.0] debug ms = 1 2026-02-22T22:16:56.249 INFO:tasks.ceph:[client.0] debug objecter = 20 2026-02-22T22:16:56.249 INFO:tasks.ceph:[client.0] debug rados = 20 2026-02-22T22:16:56.249 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-22T22:16:56.249 INFO:tasks.ceph:[global] ms type = async 2026-02-22T22:16:56.249 INFO:tasks.ceph:[global] osd debug inject dispatch delay duration = 0.1 2026-02-22T22:16:56.250 INFO:tasks.ceph:[global] osd debug inject dispatch delay probability = 0.1 2026-02-22T22:16:56.250 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 2 2026-02-22T22:16:56.250 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 1 2026-02-22T22:16:56.250 INFO:tasks.ceph:[global] osd_object_clean_region_max_num_intervals = 1000 2026-02-22T22:16:56.250 INFO:tasks.ceph:[global] osd_pg_log_trim_min = 0 2026-02-22T22:16:56.250 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2026-02-22T22:16:56.250 INFO:tasks.ceph:[global] osd_pool_default_size = 3 2026-02-22T22:16:56.250 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-22T22:16:56.250 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-22T22:16:56.250 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-22T22:16:56.250 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-22T22:16:56.250 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-22T22:16:56.250 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-22T22:16:56.251 INFO:tasks.ceph:Setting up mon.a... 2026-02-22T22:16:56.251 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-22T22:16:56.269 INFO:teuthology.orchestra.run.trial061.stdout:creating /etc/ceph/ceph.keyring 2026-02-22T22:16:56.273 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-22T22:16:56.335 DEBUG:teuthology.orchestra.run.trial061:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T22:16:56.383 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.61'), ('mon.c', '[v2:10.20.193.61:3301,v1:10.20.193.61:6790]'), ('mon.b', '10.20.193.101')] 2026-02-22T22:16:56.384 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.61,[v2:10.20.193.61:3301,v1:10.20.193.61:6790],10.20.193.101', 'mon election default strategy': 3, 'ms type': 'async', 'osd debug inject dispatch delay duration': 0.1, 'osd debug inject dispatch delay probability': 0.1, 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_object_clean_region_max_num_intervals': 1000, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on degraded': True, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd max scrubs': 1, 'osd mclock override recovery settings': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}} 2026-02-22T22:16:56.385 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T22:16:56.386 DEBUG:teuthology.orchestra.run.trial061:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-22T22:16:56.428 DEBUG:teuthology.orchestra.run.trial061:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.61 --addv c '[v2:10.20.193.61:3301,v1:10.20.193.61:6790]' --add b 10.20.193.101 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:16:56.491 INFO:teuthology.orchestra.run.trial061.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:16:56.491 INFO:teuthology.orchestra.run.trial061.stdout:monmaptool: generated fsid 24d9e668-2d30-4315-9561-54e0490ce85f 2026-02-22T22:16:56.492 INFO:teuthology.orchestra.run.trial061.stdout:setting min_mon_release = quincy 2026-02-22T22:16:56.492 INFO:teuthology.orchestra.run.trial061.stdout:epoch 0 2026-02-22T22:16:56.492 INFO:teuthology.orchestra.run.trial061.stdout:fsid 24d9e668-2d30-4315-9561-54e0490ce85f 2026-02-22T22:16:56.492 INFO:teuthology.orchestra.run.trial061.stdout:last_changed 2026-02-22T22:16:56.488244+0000 2026-02-22T22:16:56.492 INFO:teuthology.orchestra.run.trial061.stdout:created 2026-02-22T22:16:56.488244+0000 2026-02-22T22:16:56.492 INFO:teuthology.orchestra.run.trial061.stdout:min_mon_release 17 (quincy) 2026-02-22T22:16:56.492 INFO:teuthology.orchestra.run.trial061.stdout:election_strategy: 3 2026-02-22T22:16:56.492 INFO:teuthology.orchestra.run.trial061.stdout:0: [v2:10.20.193.61:3300/0,v1:10.20.193.61:6789/0] mon.a 2026-02-22T22:16:56.492 INFO:teuthology.orchestra.run.trial061.stdout:1: [v2:10.20.193.101:3300/0,v1:10.20.193.101:6789/0] mon.b 2026-02-22T22:16:56.492 INFO:teuthology.orchestra.run.trial061.stdout:2: [v2:10.20.193.61:3301/0,v1:10.20.193.61:6790/0] mon.c 2026-02-22T22:16:56.492 INFO:teuthology.orchestra.run.trial061.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-22T22:16:56.494 DEBUG:teuthology.orchestra.run.trial061:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-22T22:16:56.539 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 24d9e668-2d30-4315-9561-54e0490ce85f... 2026-02-22T22:16:56.541 DEBUG:teuthology.orchestra.run.trial061:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-22T22:16:56.581 DEBUG:teuthology.orchestra.run.trial101:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-22T22:16:56.599 INFO:teuthology.orchestra.run.trial061.stdout:[global] 2026-02-22T22:16:56.599 INFO:teuthology.orchestra.run.trial061.stdout: chdir = "" 2026-02-22T22:16:56.600 INFO:teuthology.orchestra.run.trial061.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-22T22:16:56.600 INFO:teuthology.orchestra.run.trial061.stdout: auth supported = cephx 2026-02-22T22:16:56.600 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.600 INFO:teuthology.orchestra.run.trial061.stdout: filestore xattr use omap = true 2026-02-22T22:16:56.600 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.600 INFO:teuthology.orchestra.run.trial061.stdout: mon clock drift allowed = 1.000 2026-02-22T22:16:56.600 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.600 INFO:teuthology.orchestra.run.trial061.stdout: osd crush chooseleaf type = 0 2026-02-22T22:16:56.600 INFO:teuthology.orchestra.run.trial061.stdout: auth debug = true 2026-02-22T22:16:56.600 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.601 INFO:teuthology.orchestra.run.trial061.stdout: ms die on old message = true 2026-02-22T22:16:56.601 INFO:teuthology.orchestra.run.trial061.stdout: ms die on bug = true 2026-02-22T22:16:56.601 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.601 INFO:teuthology.orchestra.run.trial061.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-22T22:16:56.601 INFO:teuthology.orchestra.run.trial061.stdout: mon pg warn max object skew = 0 2026-02-22T22:16:56.601 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.601 INFO:teuthology.orchestra.run.trial061.stdout: # disable pg_autoscaler by default for new pools 2026-02-22T22:16:56.601 INFO:teuthology.orchestra.run.trial061.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-22T22:16:56.601 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.601 INFO:teuthology.orchestra.run.trial061.stdout: osd pool default size = 2 2026-02-22T22:16:56.601 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.601 INFO:teuthology.orchestra.run.trial061.stdout: mon osd allow primary affinity = true 2026-02-22T22:16:56.602 INFO:teuthology.orchestra.run.trial061.stdout: mon osd allow pg remap = true 2026-02-22T22:16:56.602 INFO:teuthology.orchestra.run.trial061.stdout: mon warn on legacy crush tunables = false 2026-02-22T22:16:56.602 INFO:teuthology.orchestra.run.trial061.stdout: mon warn on crush straw calc version zero = false 2026-02-22T22:16:56.602 INFO:teuthology.orchestra.run.trial061.stdout: mon warn on no sortbitwise = false 2026-02-22T22:16:56.602 INFO:teuthology.orchestra.run.trial061.stdout: mon warn on osd down out interval zero = false 2026-02-22T22:16:56.602 INFO:teuthology.orchestra.run.trial061.stdout: mon warn on too few osds = false 2026-02-22T22:16:56.602 INFO:teuthology.orchestra.run.trial061.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-22T22:16:56.602 INFO:teuthology.orchestra.run.trial061.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-22T22:16:56.602 INFO:teuthology.orchestra.run.trial061.stdout: mon_allow_pool_size_one = true 2026-02-22T22:16:56.602 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.602 INFO:teuthology.orchestra.run.trial061.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-22T22:16:56.603 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.603 INFO:teuthology.orchestra.run.trial061.stdout: osd default data pool replay window = 5 2026-02-22T22:16:56.603 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.603 INFO:teuthology.orchestra.run.trial061.stdout: mon allow pool delete = true 2026-02-22T22:16:56.603 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.603 INFO:teuthology.orchestra.run.trial061.stdout: mon cluster log file level = debug 2026-02-22T22:16:56.603 INFO:teuthology.orchestra.run.trial061.stdout: debug asserts on shutdown = true 2026-02-22T22:16:56.603 INFO:teuthology.orchestra.run.trial061.stdout: mon health detail to clog = false 2026-02-22T22:16:56.603 INFO:teuthology.orchestra.run.trial061.stdout: mon host = "10.20.193.61,[v2:10.20.193.61:3301,v1:10.20.193.61:6790],10.20.193.101" 2026-02-22T22:16:56.603 INFO:teuthology.orchestra.run.trial061.stdout: mon election default strategy = 3 2026-02-22T22:16:56.603 INFO:teuthology.orchestra.run.trial061.stdout: ms type = async 2026-02-22T22:16:56.603 INFO:teuthology.orchestra.run.trial061.stdout: osd debug inject dispatch delay duration = 0.1 2026-02-22T22:16:56.603 INFO:teuthology.orchestra.run.trial061.stdout: osd debug inject dispatch delay probability = 0.1 2026-02-22T22:16:56.604 INFO:teuthology.orchestra.run.trial061.stdout: osd_max_pg_log_entries = 2 2026-02-22T22:16:56.604 INFO:teuthology.orchestra.run.trial061.stdout: osd_min_pg_log_entries = 1 2026-02-22T22:16:56.604 INFO:teuthology.orchestra.run.trial061.stdout: osd_object_clean_region_max_num_intervals = 1000 2026-02-22T22:16:56.604 INFO:teuthology.orchestra.run.trial061.stdout: osd_pg_log_trim_min = 0 2026-02-22T22:16:56.604 INFO:teuthology.orchestra.run.trial061.stdout: osd_pool_default_min_size = 2 2026-02-22T22:16:56.604 INFO:teuthology.orchestra.run.trial061.stdout: osd_pool_default_size = 3 2026-02-22T22:16:56.604 INFO:teuthology.orchestra.run.trial061.stdout: fsid = 24d9e668-2d30-4315-9561-54e0490ce85f 2026-02-22T22:16:56.604 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.604 INFO:teuthology.orchestra.run.trial061.stdout:[osd] 2026-02-22T22:16:56.604 INFO:teuthology.orchestra.run.trial061.stdout: osd journal size = 100 2026-02-22T22:16:56.604 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.604 INFO:teuthology.orchestra.run.trial061.stdout: osd scrub load threshold = 5.0 2026-02-22T22:16:56.605 INFO:teuthology.orchestra.run.trial061.stdout: osd scrub max interval = 600 2026-02-22T22:16:56.605 INFO:teuthology.orchestra.run.trial061.stdout: osd mclock profile = high_recovery_ops 2026-02-22T22:16:56.605 INFO:teuthology.orchestra.run.trial061.stdout: osd mclock skip benchmark = True 2026-02-22T22:16:56.605 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.605 INFO:teuthology.orchestra.run.trial061.stdout: osd recover clone overlap = true 2026-02-22T22:16:56.605 INFO:teuthology.orchestra.run.trial061.stdout: osd recovery max chunk = 1048576 2026-02-22T22:16:56.605 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.605 INFO:teuthology.orchestra.run.trial061.stdout: osd debug shutdown = true 2026-02-22T22:16:56.605 INFO:teuthology.orchestra.run.trial061.stdout: osd debug op order = true 2026-02-22T22:16:56.605 INFO:teuthology.orchestra.run.trial061.stdout: osd debug verify stray on activate = true 2026-02-22T22:16:56.605 INFO:teuthology.orchestra.run.trial061.stdout: osd debug trim objects = true 2026-02-22T22:16:56.605 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.605 INFO:teuthology.orchestra.run.trial061.stdout: osd open classes on start = true 2026-02-22T22:16:56.606 INFO:teuthology.orchestra.run.trial061.stdout: osd debug pg log writeout = true 2026-02-22T22:16:56.606 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.606 INFO:teuthology.orchestra.run.trial061.stdout: osd deep scrub update digest min age = 30 2026-02-22T22:16:56.606 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.606 INFO:teuthology.orchestra.run.trial061.stdout: osd map max advance = 10 2026-02-22T22:16:56.606 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.606 INFO:teuthology.orchestra.run.trial061.stdout: journal zero on create = true 2026-02-22T22:16:56.606 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.606 INFO:teuthology.orchestra.run.trial061.stdout: filestore ondisk finisher threads = 3 2026-02-22T22:16:56.606 INFO:teuthology.orchestra.run.trial061.stdout: filestore apply finisher threads = 3 2026-02-22T22:16:56.606 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.606 INFO:teuthology.orchestra.run.trial061.stdout: bdev debug aio = true 2026-02-22T22:16:56.606 INFO:teuthology.orchestra.run.trial061.stdout: osd debug misdirected ops = true 2026-02-22T22:16:56.607 INFO:teuthology.orchestra.run.trial061.stdout: debug monc = 20 2026-02-22T22:16:56.607 INFO:teuthology.orchestra.run.trial061.stdout: bdev async discard = True 2026-02-22T22:16:56.607 INFO:teuthology.orchestra.run.trial061.stdout: bdev enable discard = True 2026-02-22T22:16:56.607 INFO:teuthology.orchestra.run.trial061.stdout: bluestore block size = 96636764160 2026-02-22T22:16:56.607 INFO:teuthology.orchestra.run.trial061.stdout: bluestore fsck on mount = True 2026-02-22T22:16:56.607 INFO:teuthology.orchestra.run.trial061.stdout: bluestore zero block detection = True 2026-02-22T22:16:56.607 INFO:teuthology.orchestra.run.trial061.stdout: debug bluefs = 20 2026-02-22T22:16:56.607 INFO:teuthology.orchestra.run.trial061.stdout: debug bluestore = 20 2026-02-22T22:16:56.607 INFO:teuthology.orchestra.run.trial061.stdout: debug ms = 1 2026-02-22T22:16:56.607 INFO:teuthology.orchestra.run.trial061.stdout: debug osd = 20 2026-02-22T22:16:56.607 INFO:teuthology.orchestra.run.trial061.stdout: debug rocksdb = 10 2026-02-22T22:16:56.607 INFO:teuthology.orchestra.run.trial061.stdout: mon osd backfillfull_ratio = 0.85 2026-02-22T22:16:56.607 INFO:teuthology.orchestra.run.trial061.stdout: mon osd full ratio = 0.9 2026-02-22T22:16:56.608 INFO:teuthology.orchestra.run.trial061.stdout: mon osd nearfull ratio = 0.8 2026-02-22T22:16:56.608 INFO:teuthology.orchestra.run.trial061.stdout: osd backoff on degraded = True 2026-02-22T22:16:56.608 INFO:teuthology.orchestra.run.trial061.stdout: osd backoff on peering = True 2026-02-22T22:16:56.608 INFO:teuthology.orchestra.run.trial061.stdout: osd blocked scrub grace period = 3600 2026-02-22T22:16:56.608 INFO:teuthology.orchestra.run.trial061.stdout: osd debug verify cached snaps = True 2026-02-22T22:16:56.608 INFO:teuthology.orchestra.run.trial061.stdout: osd debug verify missing on start = True 2026-02-22T22:16:56.608 INFO:teuthology.orchestra.run.trial061.stdout: osd failsafe full ratio = 0.95 2026-02-22T22:16:56.608 INFO:teuthology.orchestra.run.trial061.stdout: osd max markdown count = 1000 2026-02-22T22:16:56.608 INFO:teuthology.orchestra.run.trial061.stdout: osd max scrubs = 1 2026-02-22T22:16:56.608 INFO:teuthology.orchestra.run.trial061.stdout: osd mclock override recovery settings = True 2026-02-22T22:16:56.608 INFO:teuthology.orchestra.run.trial061.stdout: osd memory target = 1610612736 2026-02-22T22:16:56.608 INFO:teuthology.orchestra.run.trial061.stdout: osd objectstore = bluestore 2026-02-22T22:16:56.608 INFO:teuthology.orchestra.run.trial061.stdout: osd op queue = debug_random 2026-02-22T22:16:56.609 INFO:teuthology.orchestra.run.trial061.stdout: osd op queue cut off = debug_random 2026-02-22T22:16:56.609 INFO:teuthology.orchestra.run.trial061.stdout: osd shutdown pgref assert = True 2026-02-22T22:16:56.609 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.609 INFO:teuthology.orchestra.run.trial061.stdout:[mgr] 2026-02-22T22:16:56.609 INFO:teuthology.orchestra.run.trial061.stdout: debug ms = 1 2026-02-22T22:16:56.609 INFO:teuthology.orchestra.run.trial061.stdout: debug mgr = 20 2026-02-22T22:16:56.609 INFO:teuthology.orchestra.run.trial061.stdout: debug mon = 20 2026-02-22T22:16:56.609 INFO:teuthology.orchestra.run.trial061.stdout: debug auth = 20 2026-02-22T22:16:56.609 INFO:teuthology.orchestra.run.trial061.stdout: mon reweight min pgs per osd = 4 2026-02-22T22:16:56.609 INFO:teuthology.orchestra.run.trial061.stdout: mon reweight min bytes per osd = 10 2026-02-22T22:16:56.609 INFO:teuthology.orchestra.run.trial061.stdout: mgr/telemetry/nag = false 2026-02-22T22:16:56.609 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.609 INFO:teuthology.orchestra.run.trial061.stdout:[mon] 2026-02-22T22:16:56.610 INFO:teuthology.orchestra.run.trial061.stdout: debug ms = 1 2026-02-22T22:16:56.610 INFO:teuthology.orchestra.run.trial061.stdout: debug mon = 20 2026-02-22T22:16:56.610 INFO:teuthology.orchestra.run.trial061.stdout: debug paxos = 20 2026-02-22T22:16:56.610 INFO:teuthology.orchestra.run.trial061.stdout: debug auth = 20 2026-02-22T22:16:56.610 INFO:teuthology.orchestra.run.trial061.stdout: mon data avail warn = 5 2026-02-22T22:16:56.610 INFO:teuthology.orchestra.run.trial061.stdout: mon mgr mkfs grace = 240 2026-02-22T22:16:56.610 INFO:teuthology.orchestra.run.trial061.stdout: mon reweight min pgs per osd = 4 2026-02-22T22:16:56.610 INFO:teuthology.orchestra.run.trial061.stdout: mon osd reporter subtree level = osd 2026-02-22T22:16:56.610 INFO:teuthology.orchestra.run.trial061.stdout: mon osd prime pg temp = true 2026-02-22T22:16:56.610 INFO:teuthology.orchestra.run.trial061.stdout: mon reweight min bytes per osd = 10 2026-02-22T22:16:56.610 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.610 INFO:teuthology.orchestra.run.trial061.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-22T22:16:56.610 INFO:teuthology.orchestra.run.trial061.stdout: auth mon ticket ttl = 660 # 11m 2026-02-22T22:16:56.611 INFO:teuthology.orchestra.run.trial061.stdout: auth service ticket ttl = 240 # 4m 2026-02-22T22:16:56.611 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.611 INFO:teuthology.orchestra.run.trial061.stdout: # don't complain about insecure global_id in the test suite 2026-02-22T22:16:56.611 INFO:teuthology.orchestra.run.trial061.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-22T22:16:56.611 INFO:teuthology.orchestra.run.trial061.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-22T22:16:56.611 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.611 INFO:teuthology.orchestra.run.trial061.stdout: # 1m isn't quite enough 2026-02-22T22:16:56.611 INFO:teuthology.orchestra.run.trial061.stdout: mon_down_mkfs_grace = 2m 2026-02-22T22:16:56.611 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.611 INFO:teuthology.orchestra.run.trial061.stdout: mon_warn_on_filestore_osds = false 2026-02-22T22:16:56.611 INFO:teuthology.orchestra.run.trial061.stdout: mon scrub interval = 300 2026-02-22T22:16:56.611 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:16:56.611 INFO:teuthology.orchestra.run.trial061.stdout:[client] 2026-02-22T22:16:56.612 INFO:teuthology.orchestra.run.trial061.stdout: rgw cache enabled = true 2026-02-22T22:16:56.612 INFO:teuthology.orchestra.run.trial061.stdout: rgw enable ops log = true 2026-02-22T22:16:56.612 INFO:teuthology.orchestra.run.trial061.stdout: rgw enable usage log = true 2026-02-22T22:16:56.612 INFO:teuthology.orchestra.run.trial061.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-22T22:16:56.612 INFO:teuthology.orchestra.run.trial061.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-22T22:16:56.612 INFO:teuthology.orchestra.run.trial061.stdout:[mon.a] 2026-02-22T22:16:56.612 INFO:teuthology.orchestra.run.trial061.stdout:[mon.c] 2026-02-22T22:16:56.612 INFO:teuthology.orchestra.run.trial061.stdout:[mon.b] 2026-02-22T22:16:56.612 INFO:teuthology.orchestra.run.trial061.stdout:[client.0] 2026-02-22T22:16:56.612 INFO:teuthology.orchestra.run.trial061.stdout: debug ms = 1 2026-02-22T22:16:56.612 INFO:teuthology.orchestra.run.trial061.stdout: debug objecter = 20 2026-02-22T22:16:56.612 INFO:teuthology.orchestra.run.trial061.stdout: debug rados = 20 2026-02-22T22:16:56.614 INFO:teuthology.orchestra.run.trial101.stdout:[global] 2026-02-22T22:16:56.614 INFO:teuthology.orchestra.run.trial101.stdout: chdir = "" 2026-02-22T22:16:56.615 INFO:teuthology.orchestra.run.trial101.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-22T22:16:56.615 INFO:teuthology.orchestra.run.trial101.stdout: auth supported = cephx 2026-02-22T22:16:56.615 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.615 INFO:teuthology.orchestra.run.trial101.stdout: filestore xattr use omap = true 2026-02-22T22:16:56.615 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.615 INFO:teuthology.orchestra.run.trial101.stdout: mon clock drift allowed = 1.000 2026-02-22T22:16:56.615 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.615 INFO:teuthology.orchestra.run.trial101.stdout: osd crush chooseleaf type = 0 2026-02-22T22:16:56.615 INFO:teuthology.orchestra.run.trial101.stdout: auth debug = true 2026-02-22T22:16:56.615 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.615 INFO:teuthology.orchestra.run.trial101.stdout: ms die on old message = true 2026-02-22T22:16:56.616 INFO:teuthology.orchestra.run.trial101.stdout: ms die on bug = true 2026-02-22T22:16:56.616 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.616 INFO:teuthology.orchestra.run.trial101.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-22T22:16:56.616 INFO:teuthology.orchestra.run.trial101.stdout: mon pg warn max object skew = 0 2026-02-22T22:16:56.616 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.616 INFO:teuthology.orchestra.run.trial101.stdout: # disable pg_autoscaler by default for new pools 2026-02-22T22:16:56.616 INFO:teuthology.orchestra.run.trial101.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-22T22:16:56.616 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.616 INFO:teuthology.orchestra.run.trial101.stdout: osd pool default size = 2 2026-02-22T22:16:56.616 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.616 INFO:teuthology.orchestra.run.trial101.stdout: mon osd allow primary affinity = true 2026-02-22T22:16:56.617 INFO:teuthology.orchestra.run.trial101.stdout: mon osd allow pg remap = true 2026-02-22T22:16:56.617 INFO:teuthology.orchestra.run.trial101.stdout: mon warn on legacy crush tunables = false 2026-02-22T22:16:56.617 INFO:teuthology.orchestra.run.trial101.stdout: mon warn on crush straw calc version zero = false 2026-02-22T22:16:56.617 INFO:teuthology.orchestra.run.trial101.stdout: mon warn on no sortbitwise = false 2026-02-22T22:16:56.617 INFO:teuthology.orchestra.run.trial101.stdout: mon warn on osd down out interval zero = false 2026-02-22T22:16:56.617 INFO:teuthology.orchestra.run.trial101.stdout: mon warn on too few osds = false 2026-02-22T22:16:56.617 INFO:teuthology.orchestra.run.trial101.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-22T22:16:56.617 INFO:teuthology.orchestra.run.trial101.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-22T22:16:56.617 INFO:teuthology.orchestra.run.trial101.stdout: mon_allow_pool_size_one = true 2026-02-22T22:16:56.617 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.617 INFO:teuthology.orchestra.run.trial101.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-22T22:16:56.617 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.617 INFO:teuthology.orchestra.run.trial101.stdout: osd default data pool replay window = 5 2026-02-22T22:16:56.618 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.618 INFO:teuthology.orchestra.run.trial101.stdout: mon allow pool delete = true 2026-02-22T22:16:56.618 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.618 INFO:teuthology.orchestra.run.trial101.stdout: mon cluster log file level = debug 2026-02-22T22:16:56.618 INFO:teuthology.orchestra.run.trial101.stdout: debug asserts on shutdown = true 2026-02-22T22:16:56.618 INFO:teuthology.orchestra.run.trial101.stdout: mon health detail to clog = false 2026-02-22T22:16:56.618 INFO:teuthology.orchestra.run.trial101.stdout: mon host = "10.20.193.61,[v2:10.20.193.61:3301,v1:10.20.193.61:6790],10.20.193.101" 2026-02-22T22:16:56.618 INFO:teuthology.orchestra.run.trial101.stdout: mon election default strategy = 3 2026-02-22T22:16:56.618 INFO:teuthology.orchestra.run.trial101.stdout: ms type = async 2026-02-22T22:16:56.618 INFO:teuthology.orchestra.run.trial101.stdout: osd debug inject dispatch delay duration = 0.1 2026-02-22T22:16:56.619 INFO:teuthology.orchestra.run.trial101.stdout: osd debug inject dispatch delay probability = 0.1 2026-02-22T22:16:56.619 INFO:teuthology.orchestra.run.trial101.stdout: osd_max_pg_log_entries = 2 2026-02-22T22:16:56.619 INFO:teuthology.orchestra.run.trial101.stdout: osd_min_pg_log_entries = 1 2026-02-22T22:16:56.619 INFO:teuthology.orchestra.run.trial101.stdout: osd_object_clean_region_max_num_intervals = 1000 2026-02-22T22:16:56.619 INFO:teuthology.orchestra.run.trial101.stdout: osd_pg_log_trim_min = 0 2026-02-22T22:16:56.619 INFO:teuthology.orchestra.run.trial101.stdout: osd_pool_default_min_size = 2 2026-02-22T22:16:56.619 INFO:teuthology.orchestra.run.trial101.stdout: osd_pool_default_size = 3 2026-02-22T22:16:56.619 INFO:teuthology.orchestra.run.trial101.stdout: fsid = 24d9e668-2d30-4315-9561-54e0490ce85f 2026-02-22T22:16:56.619 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.619 INFO:teuthology.orchestra.run.trial101.stdout:[osd] 2026-02-22T22:16:56.619 INFO:teuthology.orchestra.run.trial101.stdout: osd journal size = 100 2026-02-22T22:16:56.619 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.620 INFO:teuthology.orchestra.run.trial101.stdout: osd scrub load threshold = 5.0 2026-02-22T22:16:56.620 INFO:teuthology.orchestra.run.trial101.stdout: osd scrub max interval = 600 2026-02-22T22:16:56.620 INFO:teuthology.orchestra.run.trial101.stdout: osd mclock profile = high_recovery_ops 2026-02-22T22:16:56.620 INFO:teuthology.orchestra.run.trial101.stdout: osd mclock skip benchmark = True 2026-02-22T22:16:56.620 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.620 INFO:teuthology.orchestra.run.trial101.stdout: osd recover clone overlap = true 2026-02-22T22:16:56.620 INFO:teuthology.orchestra.run.trial101.stdout: osd recovery max chunk = 1048576 2026-02-22T22:16:56.620 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.620 INFO:teuthology.orchestra.run.trial101.stdout: osd debug shutdown = true 2026-02-22T22:16:56.620 INFO:teuthology.orchestra.run.trial101.stdout: osd debug op order = true 2026-02-22T22:16:56.620 INFO:teuthology.orchestra.run.trial101.stdout: osd debug verify stray on activate = true 2026-02-22T22:16:56.620 INFO:teuthology.orchestra.run.trial101.stdout: osd debug trim objects = true 2026-02-22T22:16:56.620 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.621 INFO:teuthology.orchestra.run.trial101.stdout: osd open classes on start = true 2026-02-22T22:16:56.621 INFO:teuthology.orchestra.run.trial101.stdout: osd debug pg log writeout = true 2026-02-22T22:16:56.621 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.621 INFO:teuthology.orchestra.run.trial101.stdout: osd deep scrub update digest min age = 30 2026-02-22T22:16:56.621 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.621 INFO:teuthology.orchestra.run.trial101.stdout: osd map max advance = 10 2026-02-22T22:16:56.621 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.621 INFO:teuthology.orchestra.run.trial101.stdout: journal zero on create = true 2026-02-22T22:16:56.621 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.621 INFO:teuthology.orchestra.run.trial101.stdout: filestore ondisk finisher threads = 3 2026-02-22T22:16:56.621 INFO:teuthology.orchestra.run.trial101.stdout: filestore apply finisher threads = 3 2026-02-22T22:16:56.621 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.622 INFO:teuthology.orchestra.run.trial101.stdout: bdev debug aio = true 2026-02-22T22:16:56.622 INFO:teuthology.orchestra.run.trial101.stdout: osd debug misdirected ops = true 2026-02-22T22:16:56.622 INFO:teuthology.orchestra.run.trial101.stdout: debug monc = 20 2026-02-22T22:16:56.622 INFO:teuthology.orchestra.run.trial101.stdout: bdev async discard = True 2026-02-22T22:16:56.622 INFO:teuthology.orchestra.run.trial101.stdout: bdev enable discard = True 2026-02-22T22:16:56.622 INFO:teuthology.orchestra.run.trial101.stdout: bluestore block size = 96636764160 2026-02-22T22:16:56.622 INFO:teuthology.orchestra.run.trial101.stdout: bluestore fsck on mount = True 2026-02-22T22:16:56.622 INFO:teuthology.orchestra.run.trial101.stdout: bluestore zero block detection = True 2026-02-22T22:16:56.622 INFO:teuthology.orchestra.run.trial101.stdout: debug bluefs = 20 2026-02-22T22:16:56.622 INFO:teuthology.orchestra.run.trial101.stdout: debug bluestore = 20 2026-02-22T22:16:56.622 INFO:teuthology.orchestra.run.trial101.stdout: debug ms = 1 2026-02-22T22:16:56.622 INFO:teuthology.orchestra.run.trial101.stdout: debug osd = 20 2026-02-22T22:16:56.622 INFO:teuthology.orchestra.run.trial101.stdout: debug rocksdb = 10 2026-02-22T22:16:56.623 INFO:teuthology.orchestra.run.trial101.stdout: mon osd backfillfull_ratio = 0.85 2026-02-22T22:16:56.623 INFO:teuthology.orchestra.run.trial101.stdout: mon osd full ratio = 0.9 2026-02-22T22:16:56.623 INFO:teuthology.orchestra.run.trial101.stdout: mon osd nearfull ratio = 0.8 2026-02-22T22:16:56.623 INFO:teuthology.orchestra.run.trial101.stdout: osd backoff on degraded = True 2026-02-22T22:16:56.623 INFO:teuthology.orchestra.run.trial101.stdout: osd backoff on peering = True 2026-02-22T22:16:56.623 INFO:teuthology.orchestra.run.trial101.stdout: osd blocked scrub grace period = 3600 2026-02-22T22:16:56.623 INFO:teuthology.orchestra.run.trial101.stdout: osd debug verify cached snaps = True 2026-02-22T22:16:56.623 INFO:teuthology.orchestra.run.trial101.stdout: osd debug verify missing on start = True 2026-02-22T22:16:56.623 INFO:teuthology.orchestra.run.trial101.stdout: osd failsafe full ratio = 0.95 2026-02-22T22:16:56.623 INFO:teuthology.orchestra.run.trial101.stdout: osd max markdown count = 1000 2026-02-22T22:16:56.623 INFO:teuthology.orchestra.run.trial101.stdout: osd max scrubs = 1 2026-02-22T22:16:56.623 INFO:teuthology.orchestra.run.trial101.stdout: osd mclock override recovery settings = True 2026-02-22T22:16:56.623 INFO:teuthology.orchestra.run.trial101.stdout: osd memory target = 1610612736 2026-02-22T22:16:56.624 INFO:teuthology.orchestra.run.trial101.stdout: osd objectstore = bluestore 2026-02-22T22:16:56.624 INFO:teuthology.orchestra.run.trial101.stdout: osd op queue = debug_random 2026-02-22T22:16:56.624 INFO:teuthology.orchestra.run.trial101.stdout: osd op queue cut off = debug_random 2026-02-22T22:16:56.624 INFO:teuthology.orchestra.run.trial101.stdout: osd shutdown pgref assert = True 2026-02-22T22:16:56.624 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.624 INFO:teuthology.orchestra.run.trial101.stdout:[mgr] 2026-02-22T22:16:56.624 INFO:teuthology.orchestra.run.trial101.stdout: debug ms = 1 2026-02-22T22:16:56.624 INFO:teuthology.orchestra.run.trial101.stdout: debug mgr = 20 2026-02-22T22:16:56.624 INFO:teuthology.orchestra.run.trial101.stdout: debug mon = 20 2026-02-22T22:16:56.624 INFO:teuthology.orchestra.run.trial101.stdout: debug auth = 20 2026-02-22T22:16:56.625 INFO:teuthology.orchestra.run.trial101.stdout: mon reweight min pgs per osd = 4 2026-02-22T22:16:56.625 INFO:teuthology.orchestra.run.trial101.stdout: mon reweight min bytes per osd = 10 2026-02-22T22:16:56.625 INFO:teuthology.orchestra.run.trial101.stdout: mgr/telemetry/nag = false 2026-02-22T22:16:56.625 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.625 INFO:teuthology.orchestra.run.trial101.stdout:[mon] 2026-02-22T22:16:56.625 INFO:teuthology.orchestra.run.trial101.stdout: debug ms = 1 2026-02-22T22:16:56.625 INFO:teuthology.orchestra.run.trial101.stdout: debug mon = 20 2026-02-22T22:16:56.625 INFO:teuthology.orchestra.run.trial101.stdout: debug paxos = 20 2026-02-22T22:16:56.625 INFO:teuthology.orchestra.run.trial101.stdout: debug auth = 20 2026-02-22T22:16:56.625 INFO:teuthology.orchestra.run.trial101.stdout: mon data avail warn = 5 2026-02-22T22:16:56.625 INFO:teuthology.orchestra.run.trial101.stdout: mon mgr mkfs grace = 240 2026-02-22T22:16:56.625 INFO:teuthology.orchestra.run.trial101.stdout: mon reweight min pgs per osd = 4 2026-02-22T22:16:56.625 INFO:teuthology.orchestra.run.trial101.stdout: mon osd reporter subtree level = osd 2026-02-22T22:16:56.626 INFO:teuthology.orchestra.run.trial101.stdout: mon osd prime pg temp = true 2026-02-22T22:16:56.626 INFO:teuthology.orchestra.run.trial101.stdout: mon reweight min bytes per osd = 10 2026-02-22T22:16:56.626 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.626 INFO:teuthology.orchestra.run.trial101.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-22T22:16:56.626 INFO:teuthology.orchestra.run.trial101.stdout: auth mon ticket ttl = 660 # 11m 2026-02-22T22:16:56.626 INFO:teuthology.orchestra.run.trial101.stdout: auth service ticket ttl = 240 # 4m 2026-02-22T22:16:56.626 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.626 INFO:teuthology.orchestra.run.trial101.stdout: # don't complain about insecure global_id in the test suite 2026-02-22T22:16:56.626 INFO:teuthology.orchestra.run.trial101.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-22T22:16:56.626 INFO:teuthology.orchestra.run.trial101.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-22T22:16:56.626 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.626 INFO:teuthology.orchestra.run.trial101.stdout: # 1m isn't quite enough 2026-02-22T22:16:56.627 INFO:teuthology.orchestra.run.trial101.stdout: mon_down_mkfs_grace = 2m 2026-02-22T22:16:56.627 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.627 INFO:teuthology.orchestra.run.trial101.stdout: mon_warn_on_filestore_osds = false 2026-02-22T22:16:56.627 INFO:teuthology.orchestra.run.trial101.stdout: mon scrub interval = 300 2026-02-22T22:16:56.627 INFO:teuthology.orchestra.run.trial101.stdout: 2026-02-22T22:16:56.627 INFO:teuthology.orchestra.run.trial101.stdout:[client] 2026-02-22T22:16:56.627 INFO:teuthology.orchestra.run.trial101.stdout: rgw cache enabled = true 2026-02-22T22:16:56.627 INFO:teuthology.orchestra.run.trial101.stdout: rgw enable ops log = true 2026-02-22T22:16:56.627 INFO:teuthology.orchestra.run.trial101.stdout: rgw enable usage log = true 2026-02-22T22:16:56.627 INFO:teuthology.orchestra.run.trial101.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-22T22:16:56.627 INFO:teuthology.orchestra.run.trial101.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-22T22:16:56.627 INFO:teuthology.orchestra.run.trial101.stdout:[mon.a] 2026-02-22T22:16:56.627 INFO:teuthology.orchestra.run.trial101.stdout:[mon.c] 2026-02-22T22:16:56.628 INFO:teuthology.orchestra.run.trial101.stdout:[mon.b] 2026-02-22T22:16:56.628 INFO:teuthology.orchestra.run.trial101.stdout:[client.0] 2026-02-22T22:16:56.628 INFO:teuthology.orchestra.run.trial101.stdout: debug ms = 1 2026-02-22T22:16:56.628 INFO:teuthology.orchestra.run.trial101.stdout: debug objecter = 20 2026-02-22T22:16:56.628 INFO:teuthology.orchestra.run.trial101.stdout: debug rados = 20 2026-02-22T22:16:56.628 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-22T22:16:56.628 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-22T22:16:56.681 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-22T22:16:56.681 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T22:16:56.682 DEBUG:teuthology.orchestra.run.trial061:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-22T22:16:56.728 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T22:16:56.728 DEBUG:teuthology.orchestra.run.trial061:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-22T22:16:56.776 INFO:tasks.ceph:Sending monmap to node ubuntu@trial061.front.sepia.ceph.com 2026-02-22T22:16:56.776 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T22:16:56.776 DEBUG:teuthology.orchestra.run.trial061:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-22T22:16:56.776 DEBUG:teuthology.orchestra.run.trial061:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T22:16:56.833 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T22:16:56.833 DEBUG:teuthology.orchestra.run.trial061:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:16:56.880 INFO:tasks.ceph:Sending monmap to node ubuntu@trial101.front.sepia.ceph.com 2026-02-22T22:16:56.880 DEBUG:teuthology.orchestra.run.trial101:> set -ex 2026-02-22T22:16:56.880 DEBUG:teuthology.orchestra.run.trial101:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-22T22:16:56.880 DEBUG:teuthology.orchestra.run.trial101:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-22T22:16:56.896 DEBUG:teuthology.orchestra.run.trial101:> set -ex 2026-02-22T22:16:56.896 DEBUG:teuthology.orchestra.run.trial101:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:16:56.943 INFO:tasks.ceph:Setting up mon nodes... 2026-02-22T22:16:56.943 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-22T22:16:56.943 DEBUG:teuthology.orchestra.run.trial061:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2026-02-22T22:16:56.966 INFO:teuthology.orchestra.run.trial061.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2026-02-22T22:16:56.968 DEBUG:teuthology.orchestra.run.trial101:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-22T22:16:57.009 INFO:teuthology.orchestra.run.trial101.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-22T22:16:57.012 INFO:tasks.ceph:Setting up mds nodes... 2026-02-22T22:16:57.012 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-22T22:16:57.012 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-22T22:16:57.028 INFO:teuthology.orchestra.run.trial061.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-22T22:16:57.035 DEBUG:teuthology.orchestra.run.trial101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-22T22:16:57.078 INFO:teuthology.orchestra.run.trial101.stdout:creating /etc/ceph/ceph.client.1.keyring 2026-02-22T22:16:57.085 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-22T22:16:57.085 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial061.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial101.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2026-02-22T22:16:57.085 DEBUG:teuthology.orchestra.run.trial061:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-22T22:16:57.092 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-22T22:16:57.092 INFO:tasks.ceph:role: osd.0 2026-02-22T22:16:57.092 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial061.front.sepia.ceph.com 2026-02-22T22:16:57.092 DEBUG:teuthology.orchestra.run.trial061:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-22T22:16:57.145 INFO:teuthology.orchestra.run.trial061.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T22:16:57.145 INFO:teuthology.orchestra.run.trial061.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T22:16:57.145 INFO:teuthology.orchestra.run.trial061.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T22:16:57.145 INFO:teuthology.orchestra.run.trial061.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-22T22:16:57.145 INFO:teuthology.orchestra.run.trial061.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T22:16:57.145 INFO:teuthology.orchestra.run.trial061.stdout: = sunit=0 swidth=0 blks 2026-02-22T22:16:57.146 INFO:teuthology.orchestra.run.trial061.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T22:16:57.146 INFO:teuthology.orchestra.run.trial061.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T22:16:57.146 INFO:teuthology.orchestra.run.trial061.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T22:16:57.146 INFO:teuthology.orchestra.run.trial061.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T22:16:57.735 INFO:teuthology.orchestra.run.trial061.stdout:Discarding blocks...Done. 2026-02-22T22:16:57.736 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial061.front.sepia.ceph.com -o noatime 2026-02-22T22:16:57.736 DEBUG:teuthology.orchestra.run.trial061:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-22T22:16:57.792 DEBUG:teuthology.orchestra.run.trial061:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-22T22:16:57.841 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:16:57.842 INFO:teuthology.orchestra.run.trial061.stderr:sudo: /sbin/restorecon: command not found 2026-02-22T22:16:57.842 DEBUG:teuthology.orchestra.run.trial061:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-22T22:16:57.893 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-22T22:16:57.894 INFO:tasks.ceph:role: osd.1 2026-02-22T22:16:57.894 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial061.front.sepia.ceph.com 2026-02-22T22:16:57.894 DEBUG:teuthology.orchestra.run.trial061:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-22T22:16:57.945 INFO:teuthology.orchestra.run.trial061.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T22:16:57.946 INFO:teuthology.orchestra.run.trial061.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T22:16:57.946 INFO:teuthology.orchestra.run.trial061.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T22:16:57.946 INFO:teuthology.orchestra.run.trial061.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-22T22:16:57.946 INFO:teuthology.orchestra.run.trial061.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T22:16:57.946 INFO:teuthology.orchestra.run.trial061.stdout: = sunit=0 swidth=0 blks 2026-02-22T22:16:57.946 INFO:teuthology.orchestra.run.trial061.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T22:16:57.946 INFO:teuthology.orchestra.run.trial061.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T22:16:57.946 INFO:teuthology.orchestra.run.trial061.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T22:16:57.946 INFO:teuthology.orchestra.run.trial061.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T22:16:58.510 INFO:teuthology.orchestra.run.trial061.stdout:Discarding blocks...Done. 2026-02-22T22:16:58.512 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial061.front.sepia.ceph.com -o noatime 2026-02-22T22:16:58.512 DEBUG:teuthology.orchestra.run.trial061:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-22T22:16:58.568 DEBUG:teuthology.orchestra.run.trial061:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-22T22:16:58.617 INFO:teuthology.orchestra.run.trial061.stderr:sudo: /sbin/restorecon: command not found 2026-02-22T22:16:58.618 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:16:58.618 DEBUG:teuthology.orchestra.run.trial061:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-22T22:16:58.668 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-22T22:16:58.668 INFO:tasks.ceph:role: osd.2 2026-02-22T22:16:58.668 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial061.front.sepia.ceph.com 2026-02-22T22:16:58.668 DEBUG:teuthology.orchestra.run.trial061:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-22T22:16:58.721 INFO:teuthology.orchestra.run.trial061.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T22:16:58.721 INFO:teuthology.orchestra.run.trial061.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T22:16:58.721 INFO:teuthology.orchestra.run.trial061.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T22:16:58.721 INFO:teuthology.orchestra.run.trial061.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-22T22:16:58.722 INFO:teuthology.orchestra.run.trial061.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T22:16:58.722 INFO:teuthology.orchestra.run.trial061.stdout: = sunit=0 swidth=0 blks 2026-02-22T22:16:58.722 INFO:teuthology.orchestra.run.trial061.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T22:16:58.722 INFO:teuthology.orchestra.run.trial061.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T22:16:58.722 INFO:teuthology.orchestra.run.trial061.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T22:16:58.722 INFO:teuthology.orchestra.run.trial061.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T22:16:59.288 INFO:teuthology.orchestra.run.trial061.stdout:Discarding blocks...Done. 2026-02-22T22:16:59.290 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial061.front.sepia.ceph.com -o noatime 2026-02-22T22:16:59.290 DEBUG:teuthology.orchestra.run.trial061:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-22T22:16:59.348 DEBUG:teuthology.orchestra.run.trial061:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-22T22:16:59.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:16:59.398 INFO:teuthology.orchestra.run.trial061.stderr:sudo: /sbin/restorecon: command not found 2026-02-22T22:16:59.398 DEBUG:teuthology.orchestra.run.trial061:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-22T22:16:59.448 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-22T22:16:59.448 INFO:tasks.ceph:role: osd.3 2026-02-22T22:16:59.448 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial061.front.sepia.ceph.com 2026-02-22T22:16:59.448 DEBUG:teuthology.orchestra.run.trial061:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-22T22:16:59.501 INFO:teuthology.orchestra.run.trial061.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T22:16:59.501 INFO:teuthology.orchestra.run.trial061.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T22:16:59.501 INFO:teuthology.orchestra.run.trial061.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T22:16:59.501 INFO:teuthology.orchestra.run.trial061.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-22T22:16:59.501 INFO:teuthology.orchestra.run.trial061.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T22:16:59.502 INFO:teuthology.orchestra.run.trial061.stdout: = sunit=0 swidth=0 blks 2026-02-22T22:16:59.502 INFO:teuthology.orchestra.run.trial061.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T22:16:59.502 INFO:teuthology.orchestra.run.trial061.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T22:16:59.502 INFO:teuthology.orchestra.run.trial061.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T22:16:59.502 INFO:teuthology.orchestra.run.trial061.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T22:17:00.063 INFO:teuthology.orchestra.run.trial061.stdout:Discarding blocks...Done. 2026-02-22T22:17:00.065 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial061.front.sepia.ceph.com -o noatime 2026-02-22T22:17:00.065 DEBUG:teuthology.orchestra.run.trial061:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2026-02-22T22:17:00.120 DEBUG:teuthology.orchestra.run.trial061:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-22T22:17:00.173 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:17:00.174 INFO:teuthology.orchestra.run.trial061.stderr:sudo: /sbin/restorecon: command not found 2026-02-22T22:17:00.174 DEBUG:teuthology.orchestra.run.trial061:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:17:00.237 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T22:17:00.231+0000 7f5879d588c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-22T22:17:00.238 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T22:17:00.231+0000 7f5879d588c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-22T22:17:00.238 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T22:17:00.231+0000 7f5879d588c0 -1 bdev(0x562759a75800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-22T22:17:00.238 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T22:17:00.231+0000 7f5879d588c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-22T22:17:04.320 DEBUG:teuthology.orchestra.run.trial061:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-22T22:17:04.373 DEBUG:teuthology.orchestra.run.trial061:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:17:04.440 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T22:17:04.435+0000 7faf6d2548c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-22T22:17:04.441 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T22:17:04.435+0000 7faf6d2548c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-22T22:17:04.442 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T22:17:04.435+0000 7faf6d2548c0 -1 bdev(0x55913fa71800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-22T22:17:04.442 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T22:17:04.435+0000 7faf6d2548c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-22T22:17:08.507 DEBUG:teuthology.orchestra.run.trial061:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-22T22:17:08.556 DEBUG:teuthology.orchestra.run.trial061:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:17:08.620 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T22:17:08.615+0000 7fd48e23d8c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-22T22:17:08.621 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T22:17:08.615+0000 7fd48e23d8c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-22T22:17:08.621 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T22:17:08.615+0000 7fd48e23d8c0 -1 bdev(0x563bb4f47800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-22T22:17:08.621 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T22:17:08.615+0000 7fd48e23d8c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-22T22:17:12.687 DEBUG:teuthology.orchestra.run.trial061:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-22T22:17:12.737 DEBUG:teuthology.orchestra.run.trial061:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:17:12.801 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T22:17:12.795+0000 7f364ef208c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-22T22:17:12.802 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T22:17:12.795+0000 7f364ef208c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-22T22:17:12.802 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T22:17:12.795+0000 7f364ef208c0 -1 bdev(0x55c87b00b800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-22T22:17:12.802 INFO:teuthology.orchestra.run.trial061.stderr:2026-02-22T22:17:12.795+0000 7f364ef208c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-22T22:17:16.867 DEBUG:teuthology.orchestra.run.trial061:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-22T22:17:16.917 DEBUG:teuthology.orchestra.run.trial101:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-22T22:17:16.926 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2026-02-22T22:17:16.927 INFO:tasks.ceph:role: osd.4 2026-02-22T22:17:16.927 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial101.front.sepia.ceph.com 2026-02-22T22:17:16.927 DEBUG:teuthology.orchestra.run.trial101:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-22T22:17:16.981 INFO:teuthology.orchestra.run.trial101.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T22:17:16.981 INFO:teuthology.orchestra.run.trial101.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T22:17:16.981 INFO:teuthology.orchestra.run.trial101.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T22:17:16.981 INFO:teuthology.orchestra.run.trial101.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-22T22:17:16.982 INFO:teuthology.orchestra.run.trial101.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T22:17:16.982 INFO:teuthology.orchestra.run.trial101.stdout: = sunit=0 swidth=0 blks 2026-02-22T22:17:16.982 INFO:teuthology.orchestra.run.trial101.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T22:17:16.982 INFO:teuthology.orchestra.run.trial101.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T22:17:16.982 INFO:teuthology.orchestra.run.trial101.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T22:17:16.982 INFO:teuthology.orchestra.run.trial101.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T22:17:17.569 INFO:teuthology.orchestra.run.trial101.stdout:Discarding blocks...Done. 2026-02-22T22:17:17.570 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial101.front.sepia.ceph.com -o noatime 2026-02-22T22:17:17.571 DEBUG:teuthology.orchestra.run.trial101:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2026-02-22T22:17:17.631 DEBUG:teuthology.orchestra.run.trial101:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-22T22:17:17.680 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:17:17.681 INFO:teuthology.orchestra.run.trial101.stderr:sudo: /sbin/restorecon: command not found 2026-02-22T22:17:17.681 DEBUG:teuthology.orchestra.run.trial101:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-22T22:17:17.735 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2026-02-22T22:17:17.735 INFO:tasks.ceph:role: osd.5 2026-02-22T22:17:17.735 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial101.front.sepia.ceph.com 2026-02-22T22:17:17.735 DEBUG:teuthology.orchestra.run.trial101:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-22T22:17:17.792 INFO:teuthology.orchestra.run.trial101.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T22:17:17.793 INFO:teuthology.orchestra.run.trial101.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T22:17:17.793 INFO:teuthology.orchestra.run.trial101.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T22:17:17.793 INFO:teuthology.orchestra.run.trial101.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-22T22:17:17.793 INFO:teuthology.orchestra.run.trial101.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T22:17:17.793 INFO:teuthology.orchestra.run.trial101.stdout: = sunit=0 swidth=0 blks 2026-02-22T22:17:17.793 INFO:teuthology.orchestra.run.trial101.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T22:17:17.793 INFO:teuthology.orchestra.run.trial101.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T22:17:17.793 INFO:teuthology.orchestra.run.trial101.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T22:17:17.793 INFO:teuthology.orchestra.run.trial101.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T22:17:18.358 INFO:teuthology.orchestra.run.trial101.stdout:Discarding blocks...Done. 2026-02-22T22:17:18.359 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial101.front.sepia.ceph.com -o noatime 2026-02-22T22:17:18.360 DEBUG:teuthology.orchestra.run.trial101:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2026-02-22T22:17:18.416 DEBUG:teuthology.orchestra.run.trial101:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-22T22:17:18.468 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:17:18.469 INFO:teuthology.orchestra.run.trial101.stderr:sudo: /sbin/restorecon: command not found 2026-02-22T22:17:18.469 DEBUG:teuthology.orchestra.run.trial101:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2026-02-22T22:17:18.519 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2026-02-22T22:17:18.519 INFO:tasks.ceph:role: osd.6 2026-02-22T22:17:18.519 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial101.front.sepia.ceph.com 2026-02-22T22:17:18.519 DEBUG:teuthology.orchestra.run.trial101:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-22T22:17:18.572 INFO:teuthology.orchestra.run.trial101.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T22:17:18.572 INFO:teuthology.orchestra.run.trial101.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T22:17:18.572 INFO:teuthology.orchestra.run.trial101.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T22:17:18.572 INFO:teuthology.orchestra.run.trial101.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-22T22:17:18.572 INFO:teuthology.orchestra.run.trial101.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T22:17:18.572 INFO:teuthology.orchestra.run.trial101.stdout: = sunit=0 swidth=0 blks 2026-02-22T22:17:18.572 INFO:teuthology.orchestra.run.trial101.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T22:17:18.573 INFO:teuthology.orchestra.run.trial101.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T22:17:18.573 INFO:teuthology.orchestra.run.trial101.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T22:17:18.573 INFO:teuthology.orchestra.run.trial101.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T22:17:19.144 INFO:teuthology.orchestra.run.trial101.stdout:Discarding blocks...Done. 2026-02-22T22:17:19.146 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial101.front.sepia.ceph.com -o noatime 2026-02-22T22:17:19.146 DEBUG:teuthology.orchestra.run.trial101:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2026-02-22T22:17:19.203 DEBUG:teuthology.orchestra.run.trial101:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2026-02-22T22:17:19.252 INFO:teuthology.orchestra.run.trial101.stderr:sudo: /sbin/restorecon: command not found 2026-02-22T22:17:19.252 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:17:19.252 DEBUG:teuthology.orchestra.run.trial101:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2026-02-22T22:17:19.301 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2026-02-22T22:17:19.302 INFO:tasks.ceph:role: osd.7 2026-02-22T22:17:19.302 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial101.front.sepia.ceph.com 2026-02-22T22:17:19.302 DEBUG:teuthology.orchestra.run.trial101:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-22T22:17:19.356 INFO:teuthology.orchestra.run.trial101.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-22T22:17:19.357 INFO:teuthology.orchestra.run.trial101.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-22T22:17:19.357 INFO:teuthology.orchestra.run.trial101.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-22T22:17:19.357 INFO:teuthology.orchestra.run.trial101.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-22T22:17:19.357 INFO:teuthology.orchestra.run.trial101.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-22T22:17:19.357 INFO:teuthology.orchestra.run.trial101.stdout: = sunit=0 swidth=0 blks 2026-02-22T22:17:19.357 INFO:teuthology.orchestra.run.trial101.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-22T22:17:19.357 INFO:teuthology.orchestra.run.trial101.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-22T22:17:19.357 INFO:teuthology.orchestra.run.trial101.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-22T22:17:19.357 INFO:teuthology.orchestra.run.trial101.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-22T22:17:19.917 INFO:teuthology.orchestra.run.trial101.stdout:Discarding blocks...Done. 2026-02-22T22:17:19.918 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial101.front.sepia.ceph.com -o noatime 2026-02-22T22:17:19.919 DEBUG:teuthology.orchestra.run.trial101:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2026-02-22T22:17:19.971 DEBUG:teuthology.orchestra.run.trial101:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2026-02-22T22:17:20.020 INFO:teuthology.orchestra.run.trial101.stderr:sudo: /sbin/restorecon: command not found 2026-02-22T22:17:20.021 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:17:20.022 DEBUG:teuthology.orchestra.run.trial101:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:17:20.084 INFO:teuthology.orchestra.run.trial101.stderr:2026-02-22T22:17:20.079+0000 7fbaad33b8c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-22T22:17:20.085 INFO:teuthology.orchestra.run.trial101.stderr:2026-02-22T22:17:20.079+0000 7fbaad33b8c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-22T22:17:20.085 INFO:teuthology.orchestra.run.trial101.stderr:2026-02-22T22:17:20.079+0000 7fbaad33b8c0 -1 bdev(0x55df89863800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-22T22:17:20.085 INFO:teuthology.orchestra.run.trial101.stderr:2026-02-22T22:17:20.079+0000 7fbaad33b8c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-22T22:17:24.146 DEBUG:teuthology.orchestra.run.trial101:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-22T22:17:24.199 DEBUG:teuthology.orchestra.run.trial101:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:17:24.263 INFO:teuthology.orchestra.run.trial101.stderr:2026-02-22T22:17:24.259+0000 7fceb39468c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-22T22:17:24.264 INFO:teuthology.orchestra.run.trial101.stderr:2026-02-22T22:17:24.259+0000 7fceb39468c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-22T22:17:24.264 INFO:teuthology.orchestra.run.trial101.stderr:2026-02-22T22:17:24.259+0000 7fceb39468c0 -1 bdev(0x55b6920e1800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-22T22:17:24.264 INFO:teuthology.orchestra.run.trial101.stderr:2026-02-22T22:17:24.259+0000 7fceb39468c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-22T22:17:28.334 DEBUG:teuthology.orchestra.run.trial101:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-22T22:17:28.383 DEBUG:teuthology.orchestra.run.trial101:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:17:28.447 INFO:teuthology.orchestra.run.trial101.stderr:2026-02-22T22:17:28.443+0000 7f919cc168c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2026-02-22T22:17:28.448 INFO:teuthology.orchestra.run.trial101.stderr:2026-02-22T22:17:28.443+0000 7f919cc168c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2026-02-22T22:17:28.448 INFO:teuthology.orchestra.run.trial101.stderr:2026-02-22T22:17:28.443+0000 7f919cc168c0 -1 bdev(0x56457d62d800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2026-02-22T22:17:28.448 INFO:teuthology.orchestra.run.trial101.stderr:2026-02-22T22:17:28.443+0000 7f919cc168c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2026-02-22T22:17:32.526 DEBUG:teuthology.orchestra.run.trial101:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2026-02-22T22:17:32.576 DEBUG:teuthology.orchestra.run.trial101:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:17:32.640 INFO:teuthology.orchestra.run.trial101.stderr:2026-02-22T22:17:32.635+0000 7fd6861098c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2026-02-22T22:17:32.640 INFO:teuthology.orchestra.run.trial101.stderr:2026-02-22T22:17:32.635+0000 7fd6861098c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2026-02-22T22:17:32.640 INFO:teuthology.orchestra.run.trial101.stderr:2026-02-22T22:17:32.635+0000 7fd6861098c0 -1 bdev(0x55f3ef33f800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2026-02-22T22:17:32.640 INFO:teuthology.orchestra.run.trial101.stderr:2026-02-22T22:17:32.635+0000 7fd6861098c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2026-02-22T22:17:36.709 DEBUG:teuthology.orchestra.run.trial101:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2026-02-22T22:17:36.759 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-22T22:17:36.760 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T22:17:36.760 DEBUG:teuthology.orchestra.run.trial061:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2026-02-22T22:17:36.772 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T22:17:36.772 DEBUG:teuthology.orchestra.run.trial061:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-22T22:17:36.825 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T22:17:36.825 DEBUG:teuthology.orchestra.run.trial061:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-22T22:17:36.878 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T22:17:36.878 DEBUG:teuthology.orchestra.run.trial061:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-22T22:17:36.929 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T22:17:36.929 DEBUG:teuthology.orchestra.run.trial061:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-22T22:17:36.981 DEBUG:teuthology.orchestra.run.trial101:> set -ex 2026-02-22T22:17:36.982 DEBUG:teuthology.orchestra.run.trial101:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-22T22:17:36.993 DEBUG:teuthology.orchestra.run.trial101:> set -ex 2026-02-22T22:17:36.993 DEBUG:teuthology.orchestra.run.trial101:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-22T22:17:37.044 DEBUG:teuthology.orchestra.run.trial101:> set -ex 2026-02-22T22:17:37.044 DEBUG:teuthology.orchestra.run.trial101:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-22T22:17:37.095 DEBUG:teuthology.orchestra.run.trial101:> set -ex 2026-02-22T22:17:37.096 DEBUG:teuthology.orchestra.run.trial101:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2026-02-22T22:17:37.147 DEBUG:teuthology.orchestra.run.trial101:> set -ex 2026-02-22T22:17:37.148 DEBUG:teuthology.orchestra.run.trial101:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2026-02-22T22:17:37.200 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T22:17:37.200 DEBUG:teuthology.orchestra.run.trial061:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-22T22:17:37.207 DEBUG:teuthology.orchestra.run.trial101:> set -ex 2026-02-22T22:17:37.207 DEBUG:teuthology.orchestra.run.trial101:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2026-02-22T22:17:37.247 INFO:tasks.ceph:Adding keys to all mons... 2026-02-22T22:17:37.247 DEBUG:teuthology.orchestra.run.trial061:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-22T22:17:37.249 DEBUG:teuthology.orchestra.run.trial101:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-22T22:17:37.293 INFO:teuthology.orchestra.run.trial061.stdout:[mgr.y] 2026-02-22T22:17:37.293 INFO:teuthology.orchestra.run.trial061.stdout: key = AQBYgJtpMQ1zORAAbOQn9fVNzknLRdt6zTnXyg== 2026-02-22T22:17:37.293 INFO:teuthology.orchestra.run.trial061.stdout:[osd.0] 2026-02-22T22:17:37.294 INFO:teuthology.orchestra.run.trial061.stdout: key = AQBcgJtpULH7DRAATr10rphIVR1y3yAvljl16Q== 2026-02-22T22:17:37.294 INFO:teuthology.orchestra.run.trial061.stdout:[osd.1] 2026-02-22T22:17:37.294 INFO:teuthology.orchestra.run.trial061.stdout: key = AQBggJtpI4QcGhAA3h3DDOLs7fmQllIYaz5DTg== 2026-02-22T22:17:37.294 INFO:teuthology.orchestra.run.trial061.stdout:[osd.2] 2026-02-22T22:17:37.294 INFO:teuthology.orchestra.run.trial061.stdout: key = AQBkgJtp0AHUJBAA3jKukKLuNYNzqKsnnJzxiw== 2026-02-22T22:17:37.294 INFO:teuthology.orchestra.run.trial061.stdout:[osd.3] 2026-02-22T22:17:37.294 INFO:teuthology.orchestra.run.trial061.stdout: key = AQBogJtp4OyVLxAAl4wAfmn4ujM+ZQETHbzXdA== 2026-02-22T22:17:37.294 INFO:teuthology.orchestra.run.trial061.stdout:[mgr.x] 2026-02-22T22:17:37.294 INFO:teuthology.orchestra.run.trial061.stdout: key = AQBZgJtpfzlpABAAWptdZ/ZsiKK8qf5CjdbdnQ== 2026-02-22T22:17:37.294 INFO:teuthology.orchestra.run.trial061.stdout:[osd.4] 2026-02-22T22:17:37.294 INFO:teuthology.orchestra.run.trial061.stdout: key = AQBwgJtpiSnYBBAAyWSSpdBaQRJLCYNOj7AQ9w== 2026-02-22T22:17:37.294 INFO:teuthology.orchestra.run.trial061.stdout:[osd.5] 2026-02-22T22:17:37.295 INFO:teuthology.orchestra.run.trial061.stdout: key = AQB0gJtpBIKMDxAAbsz0EeMFvd++XlDl6QiqFQ== 2026-02-22T22:17:37.295 INFO:teuthology.orchestra.run.trial061.stdout:[osd.6] 2026-02-22T22:17:37.295 INFO:teuthology.orchestra.run.trial061.stdout: key = AQB4gJtpeGB7GhAAAIp1wM+5f3XkanOJ9/Xn6Q== 2026-02-22T22:17:37.295 INFO:teuthology.orchestra.run.trial061.stdout:[osd.7] 2026-02-22T22:17:37.295 INFO:teuthology.orchestra.run.trial061.stdout: key = AQB8gJtpCXr2JRAArORpOrS+XUOZlrU1nnIrUA== 2026-02-22T22:17:37.295 INFO:teuthology.orchestra.run.trial061.stdout:[client.0] 2026-02-22T22:17:37.295 INFO:teuthology.orchestra.run.trial061.stdout: key = AQBZgJtpdiqQARAARbIqTP7iRC77pjWd7a+x2Q== 2026-02-22T22:17:37.295 INFO:teuthology.orchestra.run.trial061.stdout:[client.1] 2026-02-22T22:17:37.295 INFO:teuthology.orchestra.run.trial061.stdout: key = AQBZgJtpLtN9BBAAJTxGErB3pbh8+ybkZ7Zbng== 2026-02-22T22:17:37.297 INFO:teuthology.orchestra.run.trial101.stdout:[mgr.y] 2026-02-22T22:17:37.297 INFO:teuthology.orchestra.run.trial101.stdout: key = AQBYgJtpMQ1zORAAbOQn9fVNzknLRdt6zTnXyg== 2026-02-22T22:17:37.297 INFO:teuthology.orchestra.run.trial101.stdout:[osd.0] 2026-02-22T22:17:37.297 INFO:teuthology.orchestra.run.trial101.stdout: key = AQBcgJtpULH7DRAATr10rphIVR1y3yAvljl16Q== 2026-02-22T22:17:37.298 INFO:teuthology.orchestra.run.trial101.stdout:[osd.1] 2026-02-22T22:17:37.298 INFO:teuthology.orchestra.run.trial101.stdout: key = AQBggJtpI4QcGhAA3h3DDOLs7fmQllIYaz5DTg== 2026-02-22T22:17:37.298 INFO:teuthology.orchestra.run.trial101.stdout:[osd.2] 2026-02-22T22:17:37.298 INFO:teuthology.orchestra.run.trial101.stdout: key = AQBkgJtp0AHUJBAA3jKukKLuNYNzqKsnnJzxiw== 2026-02-22T22:17:37.298 INFO:teuthology.orchestra.run.trial101.stdout:[osd.3] 2026-02-22T22:17:37.298 INFO:teuthology.orchestra.run.trial101.stdout: key = AQBogJtp4OyVLxAAl4wAfmn4ujM+ZQETHbzXdA== 2026-02-22T22:17:37.298 INFO:teuthology.orchestra.run.trial101.stdout:[mgr.x] 2026-02-22T22:17:37.298 INFO:teuthology.orchestra.run.trial101.stdout: key = AQBZgJtpfzlpABAAWptdZ/ZsiKK8qf5CjdbdnQ== 2026-02-22T22:17:37.298 INFO:teuthology.orchestra.run.trial101.stdout:[osd.4] 2026-02-22T22:17:37.298 INFO:teuthology.orchestra.run.trial101.stdout: key = AQBwgJtpiSnYBBAAyWSSpdBaQRJLCYNOj7AQ9w== 2026-02-22T22:17:37.298 INFO:teuthology.orchestra.run.trial101.stdout:[osd.5] 2026-02-22T22:17:37.299 INFO:teuthology.orchestra.run.trial101.stdout: key = AQB0gJtpBIKMDxAAbsz0EeMFvd++XlDl6QiqFQ== 2026-02-22T22:17:37.299 INFO:teuthology.orchestra.run.trial101.stdout:[osd.6] 2026-02-22T22:17:37.299 INFO:teuthology.orchestra.run.trial101.stdout: key = AQB4gJtpeGB7GhAAAIp1wM+5f3XkanOJ9/Xn6Q== 2026-02-22T22:17:37.299 INFO:teuthology.orchestra.run.trial101.stdout:[osd.7] 2026-02-22T22:17:37.299 INFO:teuthology.orchestra.run.trial101.stdout: key = AQB8gJtpCXr2JRAArORpOrS+XUOZlrU1nnIrUA== 2026-02-22T22:17:37.299 INFO:teuthology.orchestra.run.trial101.stdout:[client.0] 2026-02-22T22:17:37.299 INFO:teuthology.orchestra.run.trial101.stdout: key = AQBZgJtpdiqQARAARbIqTP7iRC77pjWd7a+x2Q== 2026-02-22T22:17:37.299 INFO:teuthology.orchestra.run.trial101.stdout:[client.1] 2026-02-22T22:17:37.299 INFO:teuthology.orchestra.run.trial101.stdout: key = AQBZgJtpLtN9BBAAJTxGErB3pbh8+ybkZ7Zbng== 2026-02-22T22:17:37.300 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-22T22:17:37.341 DEBUG:teuthology.orchestra.run.trial101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-22T22:17:37.365 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:17:37.406 DEBUG:teuthology.orchestra.run.trial101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:17:37.428 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:17:37.469 DEBUG:teuthology.orchestra.run.trial101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:17:37.492 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:17:37.533 DEBUG:teuthology.orchestra.run.trial101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:17:37.555 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:17:37.597 DEBUG:teuthology.orchestra.run.trial101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:17:37.619 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-22T22:17:37.661 DEBUG:teuthology.orchestra.run.trial101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-22T22:17:37.682 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:17:37.725 DEBUG:teuthology.orchestra.run.trial101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:17:37.748 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:17:37.789 DEBUG:teuthology.orchestra.run.trial101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:17:37.811 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:17:37.853 DEBUG:teuthology.orchestra.run.trial101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:17:37.875 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:17:37.918 DEBUG:teuthology.orchestra.run.trial101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-22T22:17:37.939 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-22T22:17:37.981 DEBUG:teuthology.orchestra.run.trial101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-22T22:17:38.004 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-22T22:17:38.045 DEBUG:teuthology.orchestra.run.trial101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-22T22:17:38.068 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-22T22:17:38.069 DEBUG:teuthology.orchestra.run.trial061:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-22T22:17:38.120 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T22:17:38.194 DEBUG:teuthology.orchestra.run.trial061:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-22T22:17:38.244 DEBUG:teuthology.orchestra.run.trial061:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-22T22:17:38.296 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T22:17:38.365 DEBUG:teuthology.orchestra.run.trial061:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-22T22:17:38.416 DEBUG:teuthology.orchestra.run.trial101:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-22T22:17:38.426 DEBUG:teuthology.orchestra.run.trial101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-22T22:17:38.492 DEBUG:teuthology.orchestra.run.trial101:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-22T22:17:38.543 DEBUG:teuthology.orchestra.run.trial061:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:17:38.545 DEBUG:teuthology.orchestra.run.trial101:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-22T22:17:38.590 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-22T22:17:38.591 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-22T22:17:38.591 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-22T22:17:38.593 INFO:tasks.ceph.mon.a:Started 2026-02-22T22:17:38.593 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-22T22:17:38.593 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-22T22:17:38.595 INFO:tasks.ceph.mon.c:Started 2026-02-22T22:17:38.595 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-22T22:17:38.596 DEBUG:teuthology.orchestra.run.trial101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-22T22:17:38.632 INFO:tasks.ceph.mon.b:Started 2026-02-22T22:17:38.632 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-22T22:17:38.632 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-22T22:17:38.633 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2026-02-22T22:17:38.634 INFO:tasks.ceph.mgr.y:Started 2026-02-22T22:17:38.635 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-22T22:17:38.635 DEBUG:teuthology.orchestra.run.trial101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-22T22:17:38.637 INFO:tasks.ceph.mgr.x:Started 2026-02-22T22:17:38.637 INFO:tasks.ceph:Setting crush tunables to default 2026-02-22T22:17:38.637 DEBUG:teuthology.orchestra.run.trial061:> sudo ceph --cluster ceph osd crush tunables default 2026-02-22T22:17:38.972 INFO:teuthology.orchestra.run.trial061.stderr:adjusted tunables profile to default 2026-02-22T22:17:38.982 INFO:tasks.ceph:check_enable_crimson: False 2026-02-22T22:17:38.982 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-22T22:17:38.982 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T22:17:38.982 DEBUG:teuthology.orchestra.run.trial061:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-22T22:17:38.991 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T22:17:38.991 DEBUG:teuthology.orchestra.run.trial061:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-22T22:17:39.006 INFO:tasks.ceph.mgr.y.trial061.stderr:2026-02-22T22:17:38.998+0000 7ffad527a280 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-22T22:17:39.014 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T22:17:39.014 DEBUG:teuthology.orchestra.run.trial061:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-22T22:17:39.019 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:39.015+0000 7f33cb97d280 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-22T22:17:39.033 INFO:tasks.ceph.mgr.y.trial061.stderr:2026-02-22T22:17:39.026+0000 7ffad527a280 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-22T22:17:39.040 DEBUG:teuthology.orchestra.run.trial061:> set -ex 2026-02-22T22:17:39.040 DEBUG:teuthology.orchestra.run.trial061:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-22T22:17:39.045 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:39.039+0000 7f33cb97d280 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-22T22:17:39.070 INFO:tasks.ceph.mgr.y.trial061.stderr:2026-02-22T22:17:39.062+0000 7ffad527a280 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-22T22:17:39.078 DEBUG:teuthology.orchestra.run.trial101:> set -ex 2026-02-22T22:17:39.078 DEBUG:teuthology.orchestra.run.trial101:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-22T22:17:39.081 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:39.075+0000 7f33cb97d280 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-22T22:17:39.087 DEBUG:teuthology.orchestra.run.trial101:> set -ex 2026-02-22T22:17:39.087 DEBUG:teuthology.orchestra.run.trial101:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-22T22:17:39.141 DEBUG:teuthology.orchestra.run.trial101:> set -ex 2026-02-22T22:17:39.141 DEBUG:teuthology.orchestra.run.trial101:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2026-02-22T22:17:39.157 INFO:tasks.ceph.mgr.y.trial061.stderr:2026-02-22T22:17:39.150+0000 7ffad527a280 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-22T22:17:39.167 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:39.163+0000 7f33cb97d280 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-22T22:17:39.174 DEBUG:teuthology.orchestra.run.trial101:> set -ex 2026-02-22T22:17:39.175 DEBUG:teuthology.orchestra.run.trial101:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2026-02-22T22:17:39.227 DEBUG:teuthology.orchestra.run.trial101:> sudo ceph --cluster ceph osd new 5cb2e913-8f85-41b4-8d7b-d0d8389c1d9e 0 2026-02-22T22:17:39.236 INFO:tasks.ceph.mgr.y.trial061.stderr:2026-02-22T22:17:39.230+0000 7ffad527a280 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-22T22:17:39.245 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:39.239+0000 7f33cb97d280 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-22T22:17:39.273 INFO:tasks.ceph.mgr.y.trial061.stderr:2026-02-22T22:17:39.266+0000 7ffad527a280 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-22T22:17:39.282 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:39.275+0000 7f33cb97d280 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-22T22:17:39.345 INFO:teuthology.orchestra.run.trial101.stdout:0 2026-02-22T22:17:39.349 INFO:tasks.ceph.mgr.y.trial061.stderr:2026-02-22T22:17:39.342+0000 7ffad527a280 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-22T22:17:39.355 DEBUG:teuthology.orchestra.run.trial101:> sudo ceph --cluster ceph osd new b819c43c-51c0-4876-b7ce-83ad9359eb16 1 2026-02-22T22:17:39.356 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:39.351+0000 7f33cb97d280 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-22T22:17:39.454 INFO:teuthology.orchestra.run.trial101.stdout:1 2026-02-22T22:17:39.463 DEBUG:teuthology.orchestra.run.trial101:> sudo ceph --cluster ceph osd new 3ac06a05-4325-43fb-9395-6063e1207949 2 2026-02-22T22:17:39.523 INFO:tasks.ceph.mgr.y.trial061.stderr:2026-02-22T22:17:39.514+0000 7ffad527a280 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-22T22:17:39.530 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:39.527+0000 7f33cb97d280 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-22T22:17:39.562 INFO:teuthology.orchestra.run.trial101.stdout:2 2026-02-22T22:17:39.572 DEBUG:teuthology.orchestra.run.trial101:> sudo ceph --cluster ceph osd new b787eaaa-95af-46ac-bfcf-2ff3f3f96747 3 2026-02-22T22:17:39.673 INFO:teuthology.orchestra.run.trial101.stdout:3 2026-02-22T22:17:39.683 DEBUG:teuthology.orchestra.run.trial101:> sudo ceph --cluster ceph osd new aba57c87-45bb-4117-acbc-6844f4a59ec1 4 2026-02-22T22:17:39.785 INFO:teuthology.orchestra.run.trial101.stdout:4 2026-02-22T22:17:39.795 DEBUG:teuthology.orchestra.run.trial101:> sudo ceph --cluster ceph osd new 8416820d-19ef-4a33-bbb7-648f325200cc 5 2026-02-22T22:17:39.827 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:39.823+0000 7f33cb97d280 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-22T22:17:39.832 INFO:tasks.ceph.mgr.y.trial061.stderr:2026-02-22T22:17:39.822+0000 7ffad527a280 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-22T22:17:39.894 INFO:teuthology.orchestra.run.trial101.stdout:5 2026-02-22T22:17:39.903 DEBUG:teuthology.orchestra.run.trial101:> sudo ceph --cluster ceph osd new 9d6a92a6-838b-4321-9d6b-3f2ca4c147f8 6 2026-02-22T22:17:39.918 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:39.911+0000 7f33cb97d280 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-22T22:17:39.927 INFO:tasks.ceph.mgr.y.trial061.stderr:2026-02-22T22:17:39.918+0000 7ffad527a280 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-22T22:17:39.946 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:39.939+0000 7f33cb97d280 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-22T22:17:39.956 INFO:tasks.ceph.mgr.y.trial061.stderr:2026-02-22T22:17:39.946+0000 7ffad527a280 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-22T22:17:39.977 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:39.971+0000 7f33cb97d280 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-22T22:17:39.988 INFO:tasks.ceph.mgr.y.trial061.stderr:2026-02-22T22:17:39.982+0000 7ffad527a280 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-22T22:17:40.017 INFO:teuthology.orchestra.run.trial101.stdout:6 2026-02-22T22:17:40.019 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:40.015+0000 7f33cb97d280 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-22T22:17:40.026 DEBUG:teuthology.orchestra.run.trial101:> sudo ceph --cluster ceph osd new 8506f3da-648f-4271-88fa-2310fcb551f9 7 2026-02-22T22:17:40.031 INFO:tasks.ceph.mgr.y.trial061.stderr:2026-02-22T22:17:40.022+0000 7ffad527a280 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-22T22:17:40.119 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:40.115+0000 7f33cb97d280 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-22T22:17:40.136 INFO:tasks.ceph.mgr.y.trial061.stderr:2026-02-22T22:17:40.126+0000 7ffad527a280 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-22T22:17:40.165 INFO:teuthology.orchestra.run.trial101.stdout:7 2026-02-22T22:17:40.175 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-22T22:17:40.175 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-22T22:17:40.177 INFO:tasks.ceph.osd.0:Started 2026-02-22T22:17:40.177 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-22T22:17:40.177 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-22T22:17:40.179 INFO:tasks.ceph.osd.1:Started 2026-02-22T22:17:40.180 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-22T22:17:40.180 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-22T22:17:40.182 INFO:tasks.ceph.osd.2:Started 2026-02-22T22:17:40.182 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-22T22:17:40.182 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-22T22:17:40.184 INFO:tasks.ceph.osd.3:Started 2026-02-22T22:17:40.184 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-22T22:17:40.184 DEBUG:teuthology.orchestra.run.trial101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2026-02-22T22:17:40.186 INFO:tasks.ceph.osd.4:Started 2026-02-22T22:17:40.186 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-22T22:17:40.186 DEBUG:teuthology.orchestra.run.trial101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2026-02-22T22:17:40.188 INFO:tasks.ceph.osd.5:Started 2026-02-22T22:17:40.188 INFO:tasks.ceph.osd.6:Restarting daemon 2026-02-22T22:17:40.188 DEBUG:teuthology.orchestra.run.trial101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2026-02-22T22:17:40.190 INFO:tasks.ceph.osd.6:Started 2026-02-22T22:17:40.190 INFO:tasks.ceph.osd.7:Restarting daemon 2026-02-22T22:17:40.190 DEBUG:teuthology.orchestra.run.trial101:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2026-02-22T22:17:40.192 INFO:tasks.ceph.osd.7:Started 2026-02-22T22:17:40.193 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T22:17:40.288 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:17:40.288 INFO:teuthology.orchestra.run.trial061.stdout:{"epoch":10,"fsid":"24d9e668-2d30-4315-9561-54e0490ce85f","created":"2026-02-22T22:17:38.924017+0000","modified":"2026-02-22T22:17:40.160895+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T22:17:40.160895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5cb2e913-8f85-41b4-8d7b-d0d8389c1d9e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b819c43c-51c0-4876-b7ce-83ad9359eb16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3ac06a05-4325-43fb-9395-6063e1207949","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b787eaaa-95af-46ac-bfcf-2ff3f3f96747","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"aba57c87-45bb-4117-acbc-6844f4a59ec1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8416820d-19ef-4a33-bbb7-648f325200cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9d6a92a6-838b-4321-9d6b-3f2ca4c147f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8506f3da-648f-4271-88fa-2310fcb551f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T22:17:40.299 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-22T22:17:40.299 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-22T22:17:40.310 INFO:tasks.ceph.mgr.x.trial101.stderr:ERROR:root:Module 'xmltodict' is not installed. 2026-02-22T22:17:40.341 INFO:tasks.ceph.mgr.y.trial061.stderr:ERROR:root:Module 'xmltodict' is not installed. 2026-02-22T22:17:40.482 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:40.475+0000 7f33cb97d280 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-22T22:17:40.513 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:40.507+0000 7f33cb97d280 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-22T22:17:40.523 INFO:tasks.ceph.mgr.y.trial061.stderr:2026-02-22T22:17:40.514+0000 7ffad527a280 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-22T22:17:40.555 INFO:tasks.ceph.mgr.y.trial061.stderr:2026-02-22T22:17:40.546+0000 7ffad527a280 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-22T22:17:40.605 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:40.599+0000 7f33cb97d280 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-22T22:17:40.629 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:40.623+0000 7f33cb97d280 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-22T22:17:40.651 INFO:tasks.ceph.mgr.y.trial061.stderr:2026-02-22T22:17:40.642+0000 7ffad527a280 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-22T22:17:40.656 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:40.651+0000 7f33cb97d280 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-22T22:17:40.676 INFO:tasks.ceph.mgr.y.trial061.stderr:2026-02-22T22:17:40.670+0000 7ffad527a280 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-22T22:17:40.683 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:40.679+0000 7f33cb97d280 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-22T22:17:40.704 INFO:tasks.ceph.mgr.y.trial061.stderr:2026-02-22T22:17:40.698+0000 7ffad527a280 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-22T22:17:40.733 INFO:tasks.ceph.mgr.y.trial061.stderr:2026-02-22T22:17:40.726+0000 7ffad527a280 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-22T22:17:40.801 INFO:tasks.ceph.mgr.x.trial101.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-22T22:17:40.801 INFO:tasks.ceph.mgr.x.trial101.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-22T22:17:40.801 INFO:tasks.ceph.mgr.x.trial101.stderr: from numpy import show_config as show_numpy_config 2026-02-22T22:17:40.808 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:40.803+0000 7f33cb97d280 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-22T22:17:40.834 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:40.827+0000 7f33cb97d280 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-22T22:17:40.853 INFO:tasks.ceph.mgr.y.trial061.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-22T22:17:40.853 INFO:tasks.ceph.mgr.y.trial061.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-22T22:17:40.853 INFO:tasks.ceph.mgr.y.trial061.stderr: from numpy import show_config as show_numpy_config 2026-02-22T22:17:40.860 INFO:tasks.ceph.mgr.y.trial061.stderr:2026-02-22T22:17:40.854+0000 7ffad527a280 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-22T22:17:40.872 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:40.867+0000 7f33cb97d280 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-22T22:17:40.888 INFO:tasks.ceph.mgr.y.trial061.stderr:2026-02-22T22:17:40.878+0000 7ffad527a280 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-22T22:17:40.928 INFO:tasks.ceph.mgr.y.trial061.stderr:2026-02-22T22:17:40.918+0000 7ffad527a280 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-22T22:17:41.103 DEBUG:teuthology.orchestra.run.trial061:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T22:17:41.191 INFO:teuthology.misc.health.trial061.stdout: 2026-02-22T22:17:41.191 INFO:teuthology.misc.health.trial061.stdout:{"epoch":10,"fsid":"24d9e668-2d30-4315-9561-54e0490ce85f","created":"2026-02-22T22:17:38.924017+0000","modified":"2026-02-22T22:17:40.160895+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T22:17:40.160895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5cb2e913-8f85-41b4-8d7b-d0d8389c1d9e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b819c43c-51c0-4876-b7ce-83ad9359eb16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3ac06a05-4325-43fb-9395-6063e1207949","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b787eaaa-95af-46ac-bfcf-2ff3f3f96747","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"aba57c87-45bb-4117-acbc-6844f4a59ec1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8416820d-19ef-4a33-bbb7-648f325200cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9d6a92a6-838b-4321-9d6b-3f2ca4c147f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8506f3da-648f-4271-88fa-2310fcb551f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T22:17:41.199 DEBUG:teuthology.misc:0 of 8 OSDs are up 2026-02-22T22:17:41.905 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:41.899+0000 7f32ea0c9640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-22T22:17:41.905 INFO:tasks.ceph.mgr.x.trial101.stderr:2026-02-22T22:17:41.899+0000 7f32ea0c9640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-22T22:17:42.056 INFO:tasks.ceph.osd.7.trial101.stderr:2026-02-22T22:17:42.051+0000 7fdbddd418c0 -1 Falling back to public interface 2026-02-22T22:17:42.245 INFO:tasks.ceph.osd.0.trial061.stderr:2026-02-22T22:17:42.238+0000 7fc7400d18c0 -1 Falling back to public interface 2026-02-22T22:17:42.251 INFO:tasks.ceph.osd.6.trial101.stderr:2026-02-22T22:17:42.247+0000 7fbc08ceb8c0 -1 Falling back to public interface 2026-02-22T22:17:42.269 INFO:tasks.ceph.osd.1.trial061.stderr:2026-02-22T22:17:42.262+0000 7fe0ad0298c0 -1 Falling back to public interface 2026-02-22T22:17:42.280 INFO:tasks.ceph.osd.4.trial101.stderr:2026-02-22T22:17:42.275+0000 7fdcd51548c0 -1 Falling back to public interface 2026-02-22T22:17:42.285 INFO:tasks.ceph.osd.2.trial061.stderr:2026-02-22T22:17:42.278+0000 7fbb9ee528c0 -1 Falling back to public interface 2026-02-22T22:17:42.303 INFO:tasks.ceph.osd.5.trial101.stderr:2026-02-22T22:17:42.299+0000 7f08bc2fa8c0 -1 Falling back to public interface 2026-02-22T22:17:42.341 INFO:tasks.ceph.osd.3.trial061.stderr:2026-02-22T22:17:42.334+0000 7f60840978c0 -1 Falling back to public interface 2026-02-22T22:17:46.916 INFO:tasks.ceph.osd.7.trial101.stderr:2026-02-22T22:17:46.911+0000 7fdbddd418c0 -1 osd.7 0 log_to_monitors true 2026-02-22T22:17:47.051 INFO:tasks.ceph.osd.6.trial101.stderr:2026-02-22T22:17:47.047+0000 7fbc08ceb8c0 -1 osd.6 0 log_to_monitors true 2026-02-22T22:17:47.067 INFO:tasks.ceph.osd.0.trial061.stderr:2026-02-22T22:17:47.058+0000 7fc7400d18c0 -1 osd.0 0 log_to_monitors true 2026-02-22T22:17:47.142 INFO:tasks.ceph.osd.4.trial101.stderr:2026-02-22T22:17:47.135+0000 7fdcd51548c0 -1 osd.4 0 log_to_monitors true 2026-02-22T22:17:47.158 INFO:tasks.ceph.osd.1.trial061.stderr:2026-02-22T22:17:47.150+0000 7fe0ad0298c0 -1 osd.1 0 log_to_monitors true 2026-02-22T22:17:47.241 INFO:tasks.ceph.osd.2.trial061.stderr:2026-02-22T22:17:47.234+0000 7fbb9ee528c0 -1 osd.2 0 log_to_monitors true 2026-02-22T22:17:47.254 INFO:tasks.ceph.osd.5.trial101.stderr:2026-02-22T22:17:47.247+0000 7f08bc2fa8c0 -1 osd.5 0 log_to_monitors true 2026-02-22T22:17:47.275 INFO:tasks.ceph.osd.3.trial061.stderr:2026-02-22T22:17:47.266+0000 7f60840978c0 -1 osd.3 0 log_to_monitors true 2026-02-22T22:17:47.978 INFO:tasks.ceph.osd.7.trial101.stderr:2026-02-22T22:17:47.971+0000 7fdbd9cc8640 -1 osd.7 0 waiting for initial osdmap 2026-02-22T22:17:47.999 INFO:tasks.ceph.osd.7.trial101.stderr:2026-02-22T22:17:47.995+0000 7fdbd1b0c640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T22:17:48.006 DEBUG:teuthology.orchestra.run.trial061:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T22:17:48.143 INFO:teuthology.misc.health.trial061.stdout: 2026-02-22T22:17:48.143 INFO:teuthology.misc.health.trial061.stdout:{"epoch":12,"fsid":"24d9e668-2d30-4315-9561-54e0490ce85f","created":"2026-02-22T22:17:38.924017+0000","modified":"2026-02-22T22:17:47.967786+0000","last_up_change":"0.000000","last_in_change":"2026-02-22T22:17:40.160895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5cb2e913-8f85-41b4-8d7b-d0d8389c1d9e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b819c43c-51c0-4876-b7ce-83ad9359eb16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3ac06a05-4325-43fb-9395-6063e1207949","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b787eaaa-95af-46ac-bfcf-2ff3f3f96747","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"aba57c87-45bb-4117-acbc-6844f4a59ec1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8416820d-19ef-4a33-bbb7-648f325200cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9d6a92a6-838b-4321-9d6b-3f2ca4c147f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8506f3da-648f-4271-88fa-2310fcb551f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T22:17:48.152 DEBUG:teuthology.misc:0 of 8 OSDs are up 2026-02-22T22:17:48.977 INFO:tasks.ceph.osd.4.trial101.stderr:2026-02-22T22:17:48.971+0000 7fdcd10db640 -1 osd.4 0 waiting for initial osdmap 2026-02-22T22:17:48.977 INFO:tasks.ceph.osd.6.trial101.stderr:2026-02-22T22:17:48.971+0000 7fbc04c72640 -1 osd.6 0 waiting for initial osdmap 2026-02-22T22:17:48.978 INFO:tasks.ceph.osd.1.trial061.stderr:2026-02-22T22:17:48.970+0000 7fe0a8fb0640 -1 osd.1 0 waiting for initial osdmap 2026-02-22T22:17:48.979 INFO:tasks.ceph.osd.3.trial061.stderr:2026-02-22T22:17:48.970+0000 7f608001e640 -1 osd.3 0 waiting for initial osdmap 2026-02-22T22:17:48.979 INFO:tasks.ceph.osd.0.trial061.stderr:2026-02-22T22:17:48.970+0000 7fc73c058640 -1 osd.0 0 waiting for initial osdmap 2026-02-22T22:17:48.980 INFO:tasks.ceph.osd.2.trial061.stderr:2026-02-22T22:17:48.970+0000 7fbb9add9640 -1 osd.2 0 waiting for initial osdmap 2026-02-22T22:17:48.993 INFO:tasks.ceph.osd.2.trial061.stderr:2026-02-22T22:17:48.986+0000 7fbb92c1d640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T22:17:48.995 INFO:tasks.ceph.osd.6.trial101.stderr:2026-02-22T22:17:48.991+0000 7fbc00abe640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T22:17:48.996 INFO:tasks.ceph.osd.4.trial101.stderr:2026-02-22T22:17:48.991+0000 7fdcccf27640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T22:17:48.997 INFO:tasks.ceph.osd.0.trial061.stderr:2026-02-22T22:17:48.990+0000 7fc733e9c640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T22:17:49.077 INFO:tasks.ceph.osd.5.trial101.stderr:2026-02-22T22:17:49.071+0000 7f08b8281640 -1 osd.5 0 waiting for initial osdmap 2026-02-22T22:17:49.093 INFO:tasks.ceph.osd.1.trial061.stderr:2026-02-22T22:17:49.086+0000 7fe0a0df4640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T22:17:49.093 INFO:tasks.ceph.osd.3.trial061.stderr:2026-02-22T22:17:49.086+0000 7f6077e62640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T22:17:49.207 INFO:tasks.ceph.osd.5.trial101.stderr:2026-02-22T22:17:49.203+0000 7f08b00c5640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-22T22:17:54.958 DEBUG:teuthology.orchestra.run.trial061:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-22T22:17:55.099 INFO:teuthology.misc.health.trial061.stdout: 2026-02-22T22:17:55.100 INFO:teuthology.misc.health.trial061.stdout:{"epoch":19,"fsid":"24d9e668-2d30-4315-9561-54e0490ce85f","created":"2026-02-22T22:17:38.924017+0000","modified":"2026-02-22T22:17:54.995953+0000","last_up_change":"2026-02-22T22:17:49.978963+0000","last_in_change":"2026-02-22T22:17:40.160895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T22:17:50.928809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5cb2e913-8f85-41b4-8d7b-d0d8389c1d9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6800","nonce":2039210781},{"type":"v1","addr":"10.20.193.61:6801","nonce":2039210781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6802","nonce":2039210781},{"type":"v1","addr":"10.20.193.61:6803","nonce":2039210781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6806","nonce":2039210781},{"type":"v1","addr":"10.20.193.61:6807","nonce":2039210781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6804","nonce":2039210781},{"type":"v1","addr":"10.20.193.61:6805","nonce":2039210781}]},"public_addr":"10.20.193.61:6801/2039210781","cluster_addr":"10.20.193.61:6803/2039210781","heartbeat_back_addr":"10.20.193.61:6807/2039210781","heartbeat_front_addr":"10.20.193.61:6805/2039210781","state":["exists","up"]},{"osd":1,"uuid":"b819c43c-51c0-4876-b7ce-83ad9359eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6808","nonce":1753439961},{"type":"v1","addr":"10.20.193.61:6809","nonce":1753439961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6810","nonce":1753439961},{"type":"v1","addr":"10.20.193.61:6811","nonce":1753439961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6814","nonce":1753439961},{"type":"v1","addr":"10.20.193.61:6815","nonce":1753439961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6812","nonce":1753439961},{"type":"v1","addr":"10.20.193.61:6813","nonce":1753439961}]},"public_addr":"10.20.193.61:6809/1753439961","cluster_addr":"10.20.193.61:6811/1753439961","heartbeat_back_addr":"10.20.193.61:6815/1753439961","heartbeat_front_addr":"10.20.193.61:6813/1753439961","state":["exists","up"]},{"osd":2,"uuid":"3ac06a05-4325-43fb-9395-6063e1207949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6816","nonce":3859179519},{"type":"v1","addr":"10.20.193.61:6817","nonce":3859179519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6818","nonce":3859179519},{"type":"v1","addr":"10.20.193.61:6819","nonce":3859179519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6822","nonce":3859179519},{"type":"v1","addr":"10.20.193.61:6823","nonce":3859179519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6820","nonce":3859179519},{"type":"v1","addr":"10.20.193.61:6821","nonce":3859179519}]},"public_addr":"10.20.193.61:6817/3859179519","cluster_addr":"10.20.193.61:6819/3859179519","heartbeat_back_addr":"10.20.193.61:6823/3859179519","heartbeat_front_addr":"10.20.193.61:6821/3859179519","state":["exists","up"]},{"osd":3,"uuid":"b787eaaa-95af-46ac-bfcf-2ff3f3f96747","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6824","nonce":865615267},{"type":"v1","addr":"10.20.193.61:6825","nonce":865615267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6826","nonce":865615267},{"type":"v1","addr":"10.20.193.61:6827","nonce":865615267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6830","nonce":865615267},{"type":"v1","addr":"10.20.193.61:6831","nonce":865615267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6828","nonce":865615267},{"type":"v1","addr":"10.20.193.61:6829","nonce":865615267}]},"public_addr":"10.20.193.61:6825/865615267","cluster_addr":"10.20.193.61:6827/865615267","heartbeat_back_addr":"10.20.193.61:6831/865615267","heartbeat_front_addr":"10.20.193.61:6829/865615267","state":["exists","up"]},{"osd":4,"uuid":"aba57c87-45bb-4117-acbc-6844f4a59ec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6818","nonce":1598909919},{"type":"v1","addr":"10.20.193.101:6819","nonce":1598909919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6820","nonce":1598909919},{"type":"v1","addr":"10.20.193.101:6821","nonce":1598909919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6824","nonce":1598909919},{"type":"v1","addr":"10.20.193.101:6825","nonce":1598909919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6822","nonce":1598909919},{"type":"v1","addr":"10.20.193.101:6823","nonce":1598909919}]},"public_addr":"10.20.193.101:6819/1598909919","cluster_addr":"10.20.193.101:6821/1598909919","heartbeat_back_addr":"10.20.193.101:6825/1598909919","heartbeat_front_addr":"10.20.193.101:6823/1598909919","state":["exists","up"]},{"osd":5,"uuid":"8416820d-19ef-4a33-bbb7-648f325200cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6826","nonce":2416213060},{"type":"v1","addr":"10.20.193.101:6827","nonce":2416213060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6828","nonce":2416213060},{"type":"v1","addr":"10.20.193.101:6829","nonce":2416213060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6832","nonce":2416213060},{"type":"v1","addr":"10.20.193.101:6833","nonce":2416213060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6830","nonce":2416213060},{"type":"v1","addr":"10.20.193.101:6831","nonce":2416213060}]},"public_addr":"10.20.193.101:6827/2416213060","cluster_addr":"10.20.193.101:6829/2416213060","heartbeat_back_addr":"10.20.193.101:6833/2416213060","heartbeat_front_addr":"10.20.193.101:6831/2416213060","state":["exists","up"]},{"osd":6,"uuid":"9d6a92a6-838b-4321-9d6b-3f2ca4c147f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6810","nonce":1454564281},{"type":"v1","addr":"10.20.193.101:6811","nonce":1454564281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6812","nonce":1454564281},{"type":"v1","addr":"10.20.193.101:6813","nonce":1454564281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6816","nonce":1454564281},{"type":"v1","addr":"10.20.193.101:6817","nonce":1454564281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6814","nonce":1454564281},{"type":"v1","addr":"10.20.193.101:6815","nonce":1454564281}]},"public_addr":"10.20.193.101:6811/1454564281","cluster_addr":"10.20.193.101:6813/1454564281","heartbeat_back_addr":"10.20.193.101:6817/1454564281","heartbeat_front_addr":"10.20.193.101:6815/1454564281","state":["exists","up"]},{"osd":7,"uuid":"8506f3da-648f-4271-88fa-2310fcb551f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6802","nonce":2507111659},{"type":"v1","addr":"10.20.193.101:6803","nonce":2507111659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6804","nonce":2507111659},{"type":"v1","addr":"10.20.193.101:6805","nonce":2507111659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6808","nonce":2507111659},{"type":"v1","addr":"10.20.193.101:6809","nonce":2507111659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6806","nonce":2507111659},{"type":"v1","addr":"10.20.193.101:6807","nonce":2507111659}]},"public_addr":"10.20.193.101:6803/2507111659","cluster_addr":"10.20.193.101:6805/2507111659","heartbeat_back_addr":"10.20.193.101:6809/2507111659","heartbeat_front_addr":"10.20.193.101:6807/2507111659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:17:48.139039+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:17:48.271670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:17:48.038799+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:17:47.887238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T22:17:55.109 DEBUG:teuthology.misc:8 of 8 OSDs are up 2026-02-22T22:17:55.109 INFO:tasks.ceph:Creating RBD pool 2026-02-22T22:17:55.110 DEBUG:teuthology.orchestra.run.trial061:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-22T22:17:56.013 INFO:teuthology.orchestra.run.trial061.stderr:pool 'rbd' created 2026-02-22T22:17:56.026 DEBUG:teuthology.orchestra.run.trial061:> rbd --cluster ceph pool init rbd 2026-02-22T22:17:59.229 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-22T22:17:59.229 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-22T22:17:59.229 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-22T22:17:59.230 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-22T22:17:59.230 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-22T22:17:59.398 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:17:59.407 INFO:teuthology.orchestra.run.trial061.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6800","nonce":2284196077},{"type":"v1","addr":"10.20.193.101:6801","nonce":2284196077}]},"active_addr":"10.20.193.101:6801/2284196077","active_change":"2026-02-22T22:17:40.888989+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.101:0","nonce":2016028012}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.101:0","nonce":2405140659}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.101:0","nonce":2771748481}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.101:0","nonce":3644987007}]}]} 2026-02-22T22:17:59.417 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-22T22:17:59.417 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-22T22:17:59.417 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T22:17:59.572 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:17:59.573 INFO:teuthology.orchestra.run.trial061.stdout:{"epoch":23,"fsid":"24d9e668-2d30-4315-9561-54e0490ce85f","created":"2026-02-22T22:17:38.924017+0000","modified":"2026-02-22T22:17:59.015602+0000","last_up_change":"2026-02-22T22:17:49.978963+0000","last_in_change":"2026-02-22T22:17:40.160895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T22:17:50.928809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-22T22:17:55.257743+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5,"score_stable":5,"optimal_score":1,"raw_score_acting":5,"raw_score_stable":5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5cb2e913-8f85-41b4-8d7b-d0d8389c1d9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6800","nonce":2039210781},{"type":"v1","addr":"10.20.193.61:6801","nonce":2039210781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6802","nonce":2039210781},{"type":"v1","addr":"10.20.193.61:6803","nonce":2039210781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6806","nonce":2039210781},{"type":"v1","addr":"10.20.193.61:6807","nonce":2039210781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6804","nonce":2039210781},{"type":"v1","addr":"10.20.193.61:6805","nonce":2039210781}]},"public_addr":"10.20.193.61:6801/2039210781","cluster_addr":"10.20.193.61:6803/2039210781","heartbeat_back_addr":"10.20.193.61:6807/2039210781","heartbeat_front_addr":"10.20.193.61:6805/2039210781","state":["exists","up"]},{"osd":1,"uuid":"b819c43c-51c0-4876-b7ce-83ad9359eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6808","nonce":1753439961},{"type":"v1","addr":"10.20.193.61:6809","nonce":1753439961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6810","nonce":1753439961},{"type":"v1","addr":"10.20.193.61:6811","nonce":1753439961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6814","nonce":1753439961},{"type":"v1","addr":"10.20.193.61:6815","nonce":1753439961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6812","nonce":1753439961},{"type":"v1","addr":"10.20.193.61:6813","nonce":1753439961}]},"public_addr":"10.20.193.61:6809/1753439961","cluster_addr":"10.20.193.61:6811/1753439961","heartbeat_back_addr":"10.20.193.61:6815/1753439961","heartbeat_front_addr":"10.20.193.61:6813/1753439961","state":["exists","up"]},{"osd":2,"uuid":"3ac06a05-4325-43fb-9395-6063e1207949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6816","nonce":3859179519},{"type":"v1","addr":"10.20.193.61:6817","nonce":3859179519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6818","nonce":3859179519},{"type":"v1","addr":"10.20.193.61:6819","nonce":3859179519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6822","nonce":3859179519},{"type":"v1","addr":"10.20.193.61:6823","nonce":3859179519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6820","nonce":3859179519},{"type":"v1","addr":"10.20.193.61:6821","nonce":3859179519}]},"public_addr":"10.20.193.61:6817/3859179519","cluster_addr":"10.20.193.61:6819/3859179519","heartbeat_back_addr":"10.20.193.61:6823/3859179519","heartbeat_front_addr":"10.20.193.61:6821/3859179519","state":["exists","up"]},{"osd":3,"uuid":"b787eaaa-95af-46ac-bfcf-2ff3f3f96747","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6824","nonce":865615267},{"type":"v1","addr":"10.20.193.61:6825","nonce":865615267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6826","nonce":865615267},{"type":"v1","addr":"10.20.193.61:6827","nonce":865615267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6830","nonce":865615267},{"type":"v1","addr":"10.20.193.61:6831","nonce":865615267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6828","nonce":865615267},{"type":"v1","addr":"10.20.193.61:6829","nonce":865615267}]},"public_addr":"10.20.193.61:6825/865615267","cluster_addr":"10.20.193.61:6827/865615267","heartbeat_back_addr":"10.20.193.61:6831/865615267","heartbeat_front_addr":"10.20.193.61:6829/865615267","state":["exists","up"]},{"osd":4,"uuid":"aba57c87-45bb-4117-acbc-6844f4a59ec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6818","nonce":1598909919},{"type":"v1","addr":"10.20.193.101:6819","nonce":1598909919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6820","nonce":1598909919},{"type":"v1","addr":"10.20.193.101:6821","nonce":1598909919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6824","nonce":1598909919},{"type":"v1","addr":"10.20.193.101:6825","nonce":1598909919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6822","nonce":1598909919},{"type":"v1","addr":"10.20.193.101:6823","nonce":1598909919}]},"public_addr":"10.20.193.101:6819/1598909919","cluster_addr":"10.20.193.101:6821/1598909919","heartbeat_back_addr":"10.20.193.101:6825/1598909919","heartbeat_front_addr":"10.20.193.101:6823/1598909919","state":["exists","up"]},{"osd":5,"uuid":"8416820d-19ef-4a33-bbb7-648f325200cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6826","nonce":2416213060},{"type":"v1","addr":"10.20.193.101:6827","nonce":2416213060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6828","nonce":2416213060},{"type":"v1","addr":"10.20.193.101:6829","nonce":2416213060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6832","nonce":2416213060},{"type":"v1","addr":"10.20.193.101:6833","nonce":2416213060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6830","nonce":2416213060},{"type":"v1","addr":"10.20.193.101:6831","nonce":2416213060}]},"public_addr":"10.20.193.101:6827/2416213060","cluster_addr":"10.20.193.101:6829/2416213060","heartbeat_back_addr":"10.20.193.101:6833/2416213060","heartbeat_front_addr":"10.20.193.101:6831/2416213060","state":["exists","up"]},{"osd":6,"uuid":"9d6a92a6-838b-4321-9d6b-3f2ca4c147f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6810","nonce":1454564281},{"type":"v1","addr":"10.20.193.101:6811","nonce":1454564281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6812","nonce":1454564281},{"type":"v1","addr":"10.20.193.101:6813","nonce":1454564281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6816","nonce":1454564281},{"type":"v1","addr":"10.20.193.101:6817","nonce":1454564281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6814","nonce":1454564281},{"type":"v1","addr":"10.20.193.101:6815","nonce":1454564281}]},"public_addr":"10.20.193.101:6811/1454564281","cluster_addr":"10.20.193.101:6813/1454564281","heartbeat_back_addr":"10.20.193.101:6817/1454564281","heartbeat_front_addr":"10.20.193.101:6815/1454564281","state":["exists","up"]},{"osd":7,"uuid":"8506f3da-648f-4271-88fa-2310fcb551f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6802","nonce":2507111659},{"type":"v1","addr":"10.20.193.101:6803","nonce":2507111659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6804","nonce":2507111659},{"type":"v1","addr":"10.20.193.101:6805","nonce":2507111659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6808","nonce":2507111659},{"type":"v1","addr":"10.20.193.101:6809","nonce":2507111659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6806","nonce":2507111659},{"type":"v1","addr":"10.20.193.101:6807","nonce":2507111659}]},"public_addr":"10.20.193.101:6803/2507111659","cluster_addr":"10.20.193.101:6805/2507111659","heartbeat_back_addr":"10.20.193.101:6809/2507111659","heartbeat_front_addr":"10.20.193.101:6807/2507111659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:17:48.139039+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:17:48.271670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:17:48.038799+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:17:47.887238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T22:17:59.583 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-22T22:17:59.583 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T22:17:59.724 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:17:59.725 INFO:teuthology.orchestra.run.trial061.stdout:{"epoch":23,"fsid":"24d9e668-2d30-4315-9561-54e0490ce85f","created":"2026-02-22T22:17:38.924017+0000","modified":"2026-02-22T22:17:59.015602+0000","last_up_change":"2026-02-22T22:17:49.978963+0000","last_in_change":"2026-02-22T22:17:40.160895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T22:17:50.928809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-22T22:17:55.257743+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5,"score_stable":5,"optimal_score":1,"raw_score_acting":5,"raw_score_stable":5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5cb2e913-8f85-41b4-8d7b-d0d8389c1d9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6800","nonce":2039210781},{"type":"v1","addr":"10.20.193.61:6801","nonce":2039210781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6802","nonce":2039210781},{"type":"v1","addr":"10.20.193.61:6803","nonce":2039210781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6806","nonce":2039210781},{"type":"v1","addr":"10.20.193.61:6807","nonce":2039210781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6804","nonce":2039210781},{"type":"v1","addr":"10.20.193.61:6805","nonce":2039210781}]},"public_addr":"10.20.193.61:6801/2039210781","cluster_addr":"10.20.193.61:6803/2039210781","heartbeat_back_addr":"10.20.193.61:6807/2039210781","heartbeat_front_addr":"10.20.193.61:6805/2039210781","state":["exists","up"]},{"osd":1,"uuid":"b819c43c-51c0-4876-b7ce-83ad9359eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6808","nonce":1753439961},{"type":"v1","addr":"10.20.193.61:6809","nonce":1753439961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6810","nonce":1753439961},{"type":"v1","addr":"10.20.193.61:6811","nonce":1753439961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6814","nonce":1753439961},{"type":"v1","addr":"10.20.193.61:6815","nonce":1753439961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6812","nonce":1753439961},{"type":"v1","addr":"10.20.193.61:6813","nonce":1753439961}]},"public_addr":"10.20.193.61:6809/1753439961","cluster_addr":"10.20.193.61:6811/1753439961","heartbeat_back_addr":"10.20.193.61:6815/1753439961","heartbeat_front_addr":"10.20.193.61:6813/1753439961","state":["exists","up"]},{"osd":2,"uuid":"3ac06a05-4325-43fb-9395-6063e1207949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6816","nonce":3859179519},{"type":"v1","addr":"10.20.193.61:6817","nonce":3859179519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6818","nonce":3859179519},{"type":"v1","addr":"10.20.193.61:6819","nonce":3859179519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6822","nonce":3859179519},{"type":"v1","addr":"10.20.193.61:6823","nonce":3859179519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6820","nonce":3859179519},{"type":"v1","addr":"10.20.193.61:6821","nonce":3859179519}]},"public_addr":"10.20.193.61:6817/3859179519","cluster_addr":"10.20.193.61:6819/3859179519","heartbeat_back_addr":"10.20.193.61:6823/3859179519","heartbeat_front_addr":"10.20.193.61:6821/3859179519","state":["exists","up"]},{"osd":3,"uuid":"b787eaaa-95af-46ac-bfcf-2ff3f3f96747","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6824","nonce":865615267},{"type":"v1","addr":"10.20.193.61:6825","nonce":865615267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6826","nonce":865615267},{"type":"v1","addr":"10.20.193.61:6827","nonce":865615267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6830","nonce":865615267},{"type":"v1","addr":"10.20.193.61:6831","nonce":865615267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6828","nonce":865615267},{"type":"v1","addr":"10.20.193.61:6829","nonce":865615267}]},"public_addr":"10.20.193.61:6825/865615267","cluster_addr":"10.20.193.61:6827/865615267","heartbeat_back_addr":"10.20.193.61:6831/865615267","heartbeat_front_addr":"10.20.193.61:6829/865615267","state":["exists","up"]},{"osd":4,"uuid":"aba57c87-45bb-4117-acbc-6844f4a59ec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6818","nonce":1598909919},{"type":"v1","addr":"10.20.193.101:6819","nonce":1598909919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6820","nonce":1598909919},{"type":"v1","addr":"10.20.193.101:6821","nonce":1598909919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6824","nonce":1598909919},{"type":"v1","addr":"10.20.193.101:6825","nonce":1598909919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6822","nonce":1598909919},{"type":"v1","addr":"10.20.193.101:6823","nonce":1598909919}]},"public_addr":"10.20.193.101:6819/1598909919","cluster_addr":"10.20.193.101:6821/1598909919","heartbeat_back_addr":"10.20.193.101:6825/1598909919","heartbeat_front_addr":"10.20.193.101:6823/1598909919","state":["exists","up"]},{"osd":5,"uuid":"8416820d-19ef-4a33-bbb7-648f325200cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6826","nonce":2416213060},{"type":"v1","addr":"10.20.193.101:6827","nonce":2416213060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6828","nonce":2416213060},{"type":"v1","addr":"10.20.193.101:6829","nonce":2416213060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6832","nonce":2416213060},{"type":"v1","addr":"10.20.193.101:6833","nonce":2416213060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6830","nonce":2416213060},{"type":"v1","addr":"10.20.193.101:6831","nonce":2416213060}]},"public_addr":"10.20.193.101:6827/2416213060","cluster_addr":"10.20.193.101:6829/2416213060","heartbeat_back_addr":"10.20.193.101:6833/2416213060","heartbeat_front_addr":"10.20.193.101:6831/2416213060","state":["exists","up"]},{"osd":6,"uuid":"9d6a92a6-838b-4321-9d6b-3f2ca4c147f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6810","nonce":1454564281},{"type":"v1","addr":"10.20.193.101:6811","nonce":1454564281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6812","nonce":1454564281},{"type":"v1","addr":"10.20.193.101:6813","nonce":1454564281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6816","nonce":1454564281},{"type":"v1","addr":"10.20.193.101:6817","nonce":1454564281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6814","nonce":1454564281},{"type":"v1","addr":"10.20.193.101:6815","nonce":1454564281}]},"public_addr":"10.20.193.101:6811/1454564281","cluster_addr":"10.20.193.101:6813/1454564281","heartbeat_back_addr":"10.20.193.101:6817/1454564281","heartbeat_front_addr":"10.20.193.101:6815/1454564281","state":["exists","up"]},{"osd":7,"uuid":"8506f3da-648f-4271-88fa-2310fcb551f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6802","nonce":2507111659},{"type":"v1","addr":"10.20.193.101:6803","nonce":2507111659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6804","nonce":2507111659},{"type":"v1","addr":"10.20.193.101:6805","nonce":2507111659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6808","nonce":2507111659},{"type":"v1","addr":"10.20.193.101:6809","nonce":2507111659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6806","nonce":2507111659},{"type":"v1","addr":"10.20.193.101:6807","nonce":2507111659}]},"public_addr":"10.20.193.101:6803/2507111659","cluster_addr":"10.20.193.101:6805/2507111659","heartbeat_back_addr":"10.20.193.101:6809/2507111659","heartbeat_front_addr":"10.20.193.101:6807/2507111659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:17:48.139039+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:17:48.271670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:17:48.038799+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:17:47.887238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T22:17:59.735 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-22T22:17:59.736 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-22T22:17:59.737 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-22T22:17:59.737 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-22T22:17:59.737 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-22T22:17:59.738 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-22T22:17:59.738 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2026-02-22T22:17:59.739 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2026-02-22T22:17:59.830 INFO:teuthology.orchestra.run.trial061.stdout:60129542149 2026-02-22T22:17:59.830 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-22T22:17:59.831 INFO:teuthology.orchestra.run.trial061.stdout:60129542148 2026-02-22T22:17:59.832 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-22T22:17:59.832 INFO:teuthology.orchestra.run.trial061.stdout:55834574852 2026-02-22T22:17:59.833 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-22T22:17:59.834 INFO:teuthology.orchestra.run.trial061.stdout:60129542147 2026-02-22T22:17:59.834 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-22T22:17:59.837 INFO:teuthology.orchestra.run.trial061.stdout:60129542148 2026-02-22T22:17:59.838 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-22T22:17:59.839 INFO:teuthology.orchestra.run.trial061.stdout:60129542147 2026-02-22T22:17:59.839 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-22T22:17:59.842 INFO:teuthology.orchestra.run.trial061.stdout:60129542148 2026-02-22T22:17:59.842 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T22:17:59.880 INFO:teuthology.orchestra.run.trial061.stdout:60129542147 2026-02-22T22:17:59.880 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T22:17:59.985 INFO:teuthology.orchestra.run.trial061.stdout:60129542148 2026-02-22T22:17:59.996 INFO:teuthology.orchestra.run.trial061.stdout:60129542147 2026-02-22T22:17:59.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2026-02-22T22:18:00.009 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.5 2026-02-22T22:18:00.030 INFO:teuthology.orchestra.run.trial061.stdout:55834574850 2026-02-22T22:18:00.036 INFO:teuthology.orchestra.run.trial061.stdout:60129542147 2026-02-22T22:18:00.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574850 for osd.7 2026-02-22T22:18:00.044 INFO:teuthology.orchestra.run.trial061.stdout:60129542147 2026-02-22T22:18:00.044 INFO:teuthology.orchestra.run.trial061.stdout:60129542146 2026-02-22T22:18:00.049 INFO:teuthology.orchestra.run.trial061.stdout:60129542146 2026-02-22T22:18:00.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.0 2026-02-22T22:18:00.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.3 2026-02-22T22:18:00.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.2 2026-02-22T22:18:00.062 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.6 2026-02-22T22:18:00.074 INFO:teuthology.orchestra.run.trial061.stdout:60129542146 2026-02-22T22:18:00.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.1 2026-02-22T22:18:00.999 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-22T22:18:01.010 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-22T22:18:01.044 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-22T22:18:01.051 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-22T22:18:01.057 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-22T22:18:01.057 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-22T22:18:01.063 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-22T22:18:01.087 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-22T22:18:01.157 INFO:teuthology.orchestra.run.trial061.stdout:60129542148 2026-02-22T22:18:01.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2026-02-22T22:18:01.203 INFO:teuthology.orchestra.run.trial061.stdout:60129542149 2026-02-22T22:18:01.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542149 for osd.5 2026-02-22T22:18:01.217 DEBUG:teuthology.parallel:result is None 2026-02-22T22:18:01.238 INFO:teuthology.orchestra.run.trial061.stdout:60129542147 2026-02-22T22:18:01.239 INFO:teuthology.orchestra.run.trial061.stdout:55834574852 2026-02-22T22:18:01.241 INFO:teuthology.orchestra.run.trial061.stdout:60129542148 2026-02-22T22:18:01.244 INFO:teuthology.orchestra.run.trial061.stdout:60129542147 2026-02-22T22:18:01.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.6 2026-02-22T22:18:01.250 DEBUG:teuthology.parallel:result is None 2026-02-22T22:18:01.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.7 2026-02-22T22:18:01.252 INFO:teuthology.orchestra.run.trial061.stdout:60129542147 2026-02-22T22:18:01.253 DEBUG:teuthology.parallel:result is None 2026-02-22T22:18:01.254 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.0 2026-02-22T22:18:01.254 DEBUG:teuthology.parallel:result is None 2026-02-22T22:18:01.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.3 2026-02-22T22:18:01.257 DEBUG:teuthology.parallel:result is None 2026-02-22T22:18:01.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.1 2026-02-22T22:18:01.266 DEBUG:teuthology.parallel:result is None 2026-02-22T22:18:01.283 INFO:teuthology.orchestra.run.trial061.stdout:60129542148 2026-02-22T22:18:01.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.2 2026-02-22T22:18:01.296 DEBUG:teuthology.parallel:result is None 2026-02-22T22:18:02.173 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-22T22:18:02.329 INFO:teuthology.orchestra.run.trial061.stdout:60129542149 2026-02-22T22:18:02.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.4 2026-02-22T22:18:02.341 DEBUG:teuthology.parallel:result is None 2026-02-22T22:18:02.341 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-22T22:18:02.341 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T22:18:02.496 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:18:02.497 INFO:teuthology.orchestra.run.trial061.stderr:dumped all 2026-02-22T22:18:02.506 INFO:teuthology.orchestra.run.trial061.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2026-02-22T22:18:00.895042+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":64,"num_read_kb":53,"num_write":108,"num_write_kb":1889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219136,"kb_used_data":3212,"kb_used_omap":12,"kb_used_meta":215539,"kb_avail":754755584,"statfs":{"total":773094113280,"available":772869718016,"internally_reserved":0,"allocated":3289088,"data_stored":2038378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":220712504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,0,1,1,4,5],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":18,"num_write":45,"num_write_kb":1045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.885544"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-22T22:17:59.319241+0000","last_change":"2026-02-22T22:17:59.319241+0000","last_active":"2026-02-22T22:17:59.319241+0000","last_peered":"2026-02-22T22:17:59.319241+0000","last_clean":"2026-02-22T22:17:59.319241+0000","last_became_active":"2026-02-22T22:17:57.368465+0000","last_became_peered":"2026-02-22T22:17:57.368465+0000","last_unstale":"2026-02-22T22:17:59.319241+0000","last_undegraded":"2026-02-22T22:17:59.319241+0000","last_fullsized":"2026-02-22T22:17:59.319241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:25:53.847732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100604244,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-22T22:17:59.019611+0000","last_change":"2026-02-22T22:17:59.019611+0000","last_active":"2026-02-22T22:17:59.019611+0000","last_peered":"2026-02-22T22:17:59.019611+0000","last_clean":"2026-02-22T22:17:59.019611+0000","last_became_active":"2026-02-22T22:17:57.369042+0000","last_became_peered":"2026-02-22T22:17:57.369042+0000","last_unstale":"2026-02-22T22:17:59.019611+0000","last_undegraded":"2026-02-22T22:17:59.019611+0000","last_fullsized":"2026-02-22T22:17:59.019611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:27:03.006376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033978200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-22T22:17:59.219262+0000","last_change":"2026-02-22T22:17:59.219262+0000","last_active":"2026-02-22T22:17:59.219262+0000","last_peered":"2026-02-22T22:17:59.219262+0000","last_clean":"2026-02-22T22:17:59.219262+0000","last_became_active":"2026-02-22T22:17:57.116722+0000","last_became_peered":"2026-02-22T22:17:57.116722+0000","last_unstale":"2026-02-22T22:17:59.219262+0000","last_undegraded":"2026-02-22T22:17:59.219262+0000","last_fullsized":"2026-02-22T22:17:59.219262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:09:46.687325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10066288900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6],"acting":[3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-22T22:17:59.060445+0000","last_change":"2026-02-22T22:17:59.060445+0000","last_active":"2026-02-22T22:17:59.060445+0000","last_peered":"2026-02-22T22:17:59.060445+0000","last_clean":"2026-02-22T22:17:59.060445+0000","last_became_active":"2026-02-22T22:17:57.190205+0000","last_became_peered":"2026-02-22T22:17:57.190205+0000","last_unstale":"2026-02-22T22:17:59.060445+0000","last_undegraded":"2026-02-22T22:17:59.060445+0000","last_fullsized":"2026-02-22T22:17:59.060445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:45:07.425114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000249304,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"23'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-22T22:17:59.219991+0000","last_change":"2026-02-22T22:17:59.119704+0000","last_active":"2026-02-22T22:17:59.219991+0000","last_peered":"2026-02-22T22:17:59.219991+0000","last_clean":"2026-02-22T22:17:59.219991+0000","last_became_active":"2026-02-22T22:17:57.214164+0000","last_became_peered":"2026-02-22T22:17:57.214164+0000","last_unstale":"2026-02-22T22:17:59.219991+0000","last_undegraded":"2026-02-22T22:17:59.219991+0000","last_fullsized":"2026-02-22T22:17:59.219991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:37:18.081861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011410280000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-22T22:17:59.146341+0000","last_change":"2026-02-22T22:17:59.246693+0000","last_active":"2026-02-22T22:17:59.146341+0000","last_peered":"2026-02-22T22:17:59.146341+0000","last_clean":"2026-02-22T22:17:59.146341+0000","last_became_active":"2026-02-22T22:17:57.217004+0000","last_became_peered":"2026-02-22T22:17:57.217004+0000","last_unstale":"2026-02-22T22:17:59.146341+0000","last_undegraded":"2026-02-22T22:17:59.146341+0000","last_fullsized":"2026-02-22T22:17:59.146341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:16:26.325314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10045264499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-22T22:17:59.119010+0000","last_change":"2026-02-22T22:17:59.119010+0000","last_active":"2026-02-22T22:17:59.119010+0000","last_peered":"2026-02-22T22:17:59.119010+0000","last_clean":"2026-02-22T22:17:59.119010+0000","last_became_active":"2026-02-22T22:17:57.316018+0000","last_became_peered":"2026-02-22T22:17:57.316018+0000","last_unstale":"2026-02-22T22:17:59.119010+0000","last_undegraded":"2026-02-22T22:17:59.119010+0000","last_fullsized":"2026-02-22T22:17:59.119010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:50:53.540264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043909500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"21'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-22T22:17:59.218925+0000","last_change":"2026-02-22T22:17:59.218925+0000","last_active":"2026-02-22T22:17:59.218925+0000","last_peered":"2026-02-22T22:17:59.218925+0000","last_clean":"2026-02-22T22:17:59.218925+0000","last_became_active":"2026-02-22T22:17:57.016601+0000","last_became_peered":"2026-02-22T22:17:57.016601+0000","last_unstale":"2026-02-22T22:17:59.218925+0000","last_undegraded":"2026-02-22T22:17:59.218925+0000","last_fullsized":"2026-02-22T22:17:59.218925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:13:58.148122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029568900000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4],"acting":[3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"23'78","reported_seq":120,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-22T22:17:59.851668+0000","last_change":"2026-02-22T22:17:52.234714+0000","last_active":"2026-02-22T22:17:59.851668+0000","last_peered":"2026-02-22T22:17:59.851668+0000","last_clean":"2026-02-22T22:17:59.851668+0000","last_became_active":"2026-02-22T22:17:52.233814+0000","last_became_peered":"2026-02-22T22:17:52.233814+0000","last_unstale":"2026-02-22T22:17:59.851668+0000","last_undegraded":"2026-02-22T22:17:59.851668+0000","last_fullsized":"2026-02-22T22:17:59.851668+0000","mapping_epoch":15,"log_start":"23'74","ondisk_log_start":"23'74","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:50.983542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:50.983542+0000","last_clean_scrub_stamp":"2026-02-22T22:17:50.983542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":74,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:48:32.581514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":53,"num_write":106,"num_write_kb":1887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,2],"acting":[1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":53,"num_write":106,"num_write_kb":1887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1413120,"data_stored":1402464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":229376,"data_stored":75849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":237568,"data_stored":81669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542147,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":241664,"data_stored":81688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":708608,"data_stored":549157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":712704,"data_stored":549176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,0,0,1,4,5],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":225280,"data_stored":75841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":708608,"data_stored":549157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":225280,"data_stored":75841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":467488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":467488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":467488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T22:18:02.508 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T22:18:02.651 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:18:02.652 INFO:teuthology.orchestra.run.trial061.stderr:dumped all 2026-02-22T22:18:02.661 INFO:teuthology.orchestra.run.trial061.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2026-02-22T22:18:00.895042+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":64,"num_read_kb":53,"num_write":108,"num_write_kb":1889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219136,"kb_used_data":3212,"kb_used_omap":12,"kb_used_meta":215539,"kb_avail":754755584,"statfs":{"total":773094113280,"available":772869718016,"internally_reserved":0,"allocated":3289088,"data_stored":2038378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":220712504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,0,1,1,4,5],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":18,"num_write":45,"num_write_kb":1045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.885544"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-22T22:17:59.319241+0000","last_change":"2026-02-22T22:17:59.319241+0000","last_active":"2026-02-22T22:17:59.319241+0000","last_peered":"2026-02-22T22:17:59.319241+0000","last_clean":"2026-02-22T22:17:59.319241+0000","last_became_active":"2026-02-22T22:17:57.368465+0000","last_became_peered":"2026-02-22T22:17:57.368465+0000","last_unstale":"2026-02-22T22:17:59.319241+0000","last_undegraded":"2026-02-22T22:17:59.319241+0000","last_fullsized":"2026-02-22T22:17:59.319241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:25:53.847732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100604244,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-22T22:17:59.019611+0000","last_change":"2026-02-22T22:17:59.019611+0000","last_active":"2026-02-22T22:17:59.019611+0000","last_peered":"2026-02-22T22:17:59.019611+0000","last_clean":"2026-02-22T22:17:59.019611+0000","last_became_active":"2026-02-22T22:17:57.369042+0000","last_became_peered":"2026-02-22T22:17:57.369042+0000","last_unstale":"2026-02-22T22:17:59.019611+0000","last_undegraded":"2026-02-22T22:17:59.019611+0000","last_fullsized":"2026-02-22T22:17:59.019611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:27:03.006376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033978200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-22T22:17:59.219262+0000","last_change":"2026-02-22T22:17:59.219262+0000","last_active":"2026-02-22T22:17:59.219262+0000","last_peered":"2026-02-22T22:17:59.219262+0000","last_clean":"2026-02-22T22:17:59.219262+0000","last_became_active":"2026-02-22T22:17:57.116722+0000","last_became_peered":"2026-02-22T22:17:57.116722+0000","last_unstale":"2026-02-22T22:17:59.219262+0000","last_undegraded":"2026-02-22T22:17:59.219262+0000","last_fullsized":"2026-02-22T22:17:59.219262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:09:46.687325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10066288900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6],"acting":[3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-22T22:17:59.060445+0000","last_change":"2026-02-22T22:17:59.060445+0000","last_active":"2026-02-22T22:17:59.060445+0000","last_peered":"2026-02-22T22:17:59.060445+0000","last_clean":"2026-02-22T22:17:59.060445+0000","last_became_active":"2026-02-22T22:17:57.190205+0000","last_became_peered":"2026-02-22T22:17:57.190205+0000","last_unstale":"2026-02-22T22:17:59.060445+0000","last_undegraded":"2026-02-22T22:17:59.060445+0000","last_fullsized":"2026-02-22T22:17:59.060445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:45:07.425114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000249304,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"23'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-22T22:17:59.219991+0000","last_change":"2026-02-22T22:17:59.119704+0000","last_active":"2026-02-22T22:17:59.219991+0000","last_peered":"2026-02-22T22:17:59.219991+0000","last_clean":"2026-02-22T22:17:59.219991+0000","last_became_active":"2026-02-22T22:17:57.214164+0000","last_became_peered":"2026-02-22T22:17:57.214164+0000","last_unstale":"2026-02-22T22:17:59.219991+0000","last_undegraded":"2026-02-22T22:17:59.219991+0000","last_fullsized":"2026-02-22T22:17:59.219991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:37:18.081861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011410280000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-22T22:17:59.146341+0000","last_change":"2026-02-22T22:17:59.246693+0000","last_active":"2026-02-22T22:17:59.146341+0000","last_peered":"2026-02-22T22:17:59.146341+0000","last_clean":"2026-02-22T22:17:59.146341+0000","last_became_active":"2026-02-22T22:17:57.217004+0000","last_became_peered":"2026-02-22T22:17:57.217004+0000","last_unstale":"2026-02-22T22:17:59.146341+0000","last_undegraded":"2026-02-22T22:17:59.146341+0000","last_fullsized":"2026-02-22T22:17:59.146341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:16:26.325314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10045264499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-22T22:17:59.119010+0000","last_change":"2026-02-22T22:17:59.119010+0000","last_active":"2026-02-22T22:17:59.119010+0000","last_peered":"2026-02-22T22:17:59.119010+0000","last_clean":"2026-02-22T22:17:59.119010+0000","last_became_active":"2026-02-22T22:17:57.316018+0000","last_became_peered":"2026-02-22T22:17:57.316018+0000","last_unstale":"2026-02-22T22:17:59.119010+0000","last_undegraded":"2026-02-22T22:17:59.119010+0000","last_fullsized":"2026-02-22T22:17:59.119010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T05:50:53.540264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043909500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"21'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-22T22:17:59.218925+0000","last_change":"2026-02-22T22:17:59.218925+0000","last_active":"2026-02-22T22:17:59.218925+0000","last_peered":"2026-02-22T22:17:59.218925+0000","last_clean":"2026-02-22T22:17:59.218925+0000","last_became_active":"2026-02-22T22:17:57.016601+0000","last_became_peered":"2026-02-22T22:17:57.016601+0000","last_unstale":"2026-02-22T22:17:59.218925+0000","last_undegraded":"2026-02-22T22:17:59.218925+0000","last_fullsized":"2026-02-22T22:17:59.218925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:13:58.148122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029568900000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4],"acting":[3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"23'78","reported_seq":120,"reported_epoch":23,"state":"active+clean","last_fresh":"2026-02-22T22:17:59.851668+0000","last_change":"2026-02-22T22:17:52.234714+0000","last_active":"2026-02-22T22:17:59.851668+0000","last_peered":"2026-02-22T22:17:59.851668+0000","last_clean":"2026-02-22T22:17:59.851668+0000","last_became_active":"2026-02-22T22:17:52.233814+0000","last_became_peered":"2026-02-22T22:17:52.233814+0000","last_unstale":"2026-02-22T22:17:59.851668+0000","last_undegraded":"2026-02-22T22:17:59.851668+0000","last_fullsized":"2026-02-22T22:17:59.851668+0000","mapping_epoch":15,"log_start":"23'74","ondisk_log_start":"23'74","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:50.983542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:50.983542+0000","last_clean_scrub_stamp":"2026-02-22T22:17:50.983542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":74,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:48:32.581514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":53,"num_write":106,"num_write_kb":1887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,2],"acting":[1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":53,"num_write":106,"num_write_kb":1887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1413120,"data_stored":1402464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":229376,"data_stored":75849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":237568,"data_stored":81669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542147,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":241664,"data_stored":81688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":708608,"data_stored":549157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":712704,"data_stored":549176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,0,0,1,4,5],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":225280,"data_stored":75841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":708608,"data_stored":549157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":225280,"data_stored":75841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":467488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":467488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":467488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T22:18:02.663 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-22T22:18:02.663 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-22T22:18:02.663 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-22T22:18:02.664 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-22T22:18:02.824 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:18:02.824 INFO:teuthology.orchestra.run.trial061.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-22T22:18:02.835 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-22T22:18:02.835 INFO:teuthology.run_tasks:Running task exec... 2026-02-22T22:18:02.852 INFO:teuthology.task.exec:Executing custom commands... 2026-02-22T22:18:02.852 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@trial061.front.sepia.ceph.com 2026-02-22T22:18:02.852 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/balancer/log_level debug' 2026-02-22T22:18:03.013 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph balancer status' 2026-02-22T22:18:03.158 INFO:teuthology.orchestra.run.trial061.stdout:{ 2026-02-22T22:18:03.158 INFO:teuthology.orchestra.run.trial061.stdout: "active": true, 2026-02-22T22:18:03.158 INFO:teuthology.orchestra.run.trial061.stdout: "last_optimize_duration": "0:00:00.000179", 2026-02-22T22:18:03.158 INFO:teuthology.orchestra.run.trial061.stdout: "last_optimize_started": "Sun Feb 22 22:17:40 2026", 2026-02-22T22:18:03.158 INFO:teuthology.orchestra.run.trial061.stdout: "mode": "upmap", 2026-02-22T22:18:03.159 INFO:teuthology.orchestra.run.trial061.stdout: "no_optimization_needed": false, 2026-02-22T22:18:03.159 INFO:teuthology.orchestra.run.trial061.stdout: "optimize_result": "No pools available", 2026-02-22T22:18:03.159 INFO:teuthology.orchestra.run.trial061.stdout: "plans": [] 2026-02-22T22:18:03.159 INFO:teuthology.orchestra.run.trial061.stdout:} 2026-02-22T22:18:03.169 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client reef' 2026-02-22T22:18:03.641 INFO:teuthology.orchestra.run.trial061.stderr:set require_min_compat_client to reef 2026-02-22T22:18:03.653 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph balancer mode read' 2026-02-22T22:18:03.811 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph balancer on' 2026-02-22T22:18:03.964 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph balancer status' 2026-02-22T22:18:04.112 INFO:teuthology.orchestra.run.trial061.stdout:{ 2026-02-22T22:18:04.112 INFO:teuthology.orchestra.run.trial061.stdout: "active": true, 2026-02-22T22:18:04.113 INFO:teuthology.orchestra.run.trial061.stdout: "last_optimize_duration": "0:00:00.000341", 2026-02-22T22:18:04.113 INFO:teuthology.orchestra.run.trial061.stdout: "last_optimize_started": "Sun Feb 22 22:18:03 2026", 2026-02-22T22:18:04.113 INFO:teuthology.orchestra.run.trial061.stdout: "mode": "read", 2026-02-22T22:18:04.113 INFO:teuthology.orchestra.run.trial061.stdout: "no_optimization_needed": false, 2026-02-22T22:18:04.113 INFO:teuthology.orchestra.run.trial061.stdout: "optimize_result": "Optimization plan created successfully", 2026-02-22T22:18:04.113 INFO:teuthology.orchestra.run.trial061.stdout: "plans": [] 2026-02-22T22:18:04.113 INFO:teuthology.orchestra.run.trial061.stdout:} 2026-02-22T22:18:04.125 DEBUG:teuthology.orchestra.run.trial061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph balancer status detail' 2026-02-22T22:18:04.273 INFO:teuthology.orchestra.run.trial061.stdout:This command is disabled. 2026-02-22T22:18:04.274 INFO:teuthology.orchestra.run.trial061.stdout:To enable, run `ceph config set mgr mgr/balancer/update_pg_upmap_activity True`. 2026-02-22T22:18:04.284 INFO:teuthology.run_tasks:Running task full_sequential... 2026-02-22T22:18:04.302 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-22T22:18:04.305 INFO:tasks.radosbench:Beginning radosbench... 2026-02-22T22:18:04.306 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2026-02-22T22:18:04.306 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2026-02-22T22:18:04.800 INFO:teuthology.orchestra.run.trial061.stderr:pool 'unique_pool_0' created 2026-02-22T22:18:04.815 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2026-02-22T22:18:05.805 INFO:teuthology.orchestra.run.trial061.stderr:enabled application 'rados' on pool 'unique_pool_0' 2026-02-22T22:18:06.820 DEBUG:teuthology.orchestra.run.trial061:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_0 bench 90 write' 2026-02-22T22:18:06.823 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-22T22:18:06.823 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-22T22:18:06.847 INFO:tasks.radosbench.radosbench.0.trial061.stdout:hints = 1 2026-02-22T22:18:06.848 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-22T22:18:06.848 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Object prefix: benchmark_data_trial061_22131 2026-02-22T22:18:06.848 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:18:06.848 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 0 0 0 0 0 0 - 0 2026-02-22T22:18:07.848 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 1 16 55 39 0.304665 0.304688 0.303721 0.326245 2026-02-22T22:18:08.848 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 2 16 93 77 0.300759 0.296875 0.102442 0.372304 2026-02-22T22:18:09.848 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 3 16 128 112 0.291646 0.273438 0.606014 0.391034 2026-02-22T22:18:10.848 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 4 16 172 156 0.304666 0.34375 0.30254 0.38031 2026-02-22T22:18:11.848 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 5 16 202 186 0.290605 0.234375 0.400777 0.399475 2026-02-22T22:18:12.848 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 6 16 243 227 0.295553 0.320312 0.102689 0.404326 2026-02-22T22:18:13.848 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 7 16 282 266 0.296855 0.304688 0.302444 0.405379 2026-02-22T22:18:14.848 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 8 16 320 304 0.296855 0.296875 0.303898 0.412043 2026-02-22T22:18:15.848 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 9 16 360 344 0.298591 0.3125 0.803789 0.411259 2026-02-22T22:18:16.848 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 10 16 400 384 0.29998 0.3125 0.104582 0.409507 2026-02-22T22:18:17.848 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 11 16 432 416 0.295435 0.25 0.604066 0.414248 2026-02-22T22:18:18.848 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 12 16 471 455 0.296204 0.304688 0.702159 0.414544 2026-02-22T22:18:19.849 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 13 16 519 503 0.302263 0.375 0.302044 0.407475 2026-02-22T22:18:20.849 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 14 16 558 542 0.302435 0.304688 0.504025 0.407708 2026-02-22T22:18:21.849 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 15 16 605 589 0.30675 0.367188 0.203345 0.402896 2026-02-22T22:18:22.849 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 16 16 643 627 0.306132 0.296875 0.502963 0.402377 2026-02-22T22:18:23.849 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 17 16 692 676 0.310641 0.382812 0.103439 0.396044 2026-02-22T22:18:24.849 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 18 16 725 709 0.307705 0.257812 0.303494 0.400781 2026-02-22T22:18:25.849 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 19 16 774 758 0.311657 0.382812 0.405855 0.395778 2026-02-22T22:18:26.849 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:18:26.845970+0000 min lat: 0.0012379 max lat: 0.907101 avg lat: 0.398214 2026-02-22T22:18:26.849 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:18:26.849 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 20 16 813 797 0.311307 0.304688 0.505971 0.398214 2026-02-22T22:18:27.849 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 21 16 855 839 0.312107 0.328125 0.302325 0.397103 2026-02-22T22:18:28.849 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 22 16 892 876 0.311058 0.289062 0.603215 0.396399 2026-02-22T22:18:29.849 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 23 16 932 916 0.31112 0.3125 0.201571 0.397457 2026-02-22T22:18:30.849 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 24 16 984 968 0.315083 0.40625 0.505726 0.39387 2026-02-22T22:18:31.849 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 25 16 1026 1010 0.315604 0.328125 0.00144417 0.392702 2026-02-22T22:18:32.850 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 26 16 1066 1050 0.315483 0.3125 0.302647 0.394068 2026-02-22T22:18:33.850 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 27 16 1095 1079 0.31219 0.226562 0.793863 0.396311 2026-02-22T22:18:34.850 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 28 16 1133 1117 0.311642 0.296875 0.400628 0.395898 2026-02-22T22:18:35.850 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 29 16 1161 1145 0.308438 0.21875 0.60666 0.398935 2026-02-22T22:18:36.850 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 30 16 1206 1190 0.309875 0.351562 0.305717 0.400083 2026-02-22T22:18:37.850 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 31 16 1239 1223 0.308195 0.257812 0.507367 0.401217 2026-02-22T22:18:38.850 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 32 16 1291 1275 0.311258 0.40625 0.202362 0.399246 2026-02-22T22:18:39.850 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 33 16 1342 1326 0.313899 0.398438 0.402445 0.395689 2026-02-22T22:18:40.850 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 34 16 1383 1367 0.314087 0.320312 0.302068 0.393402 2026-02-22T22:18:41.850 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 35 16 1422 1406 0.313818 0.304688 0.602061 0.395132 2026-02-22T22:18:42.850 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 36 16 1456 1440 0.312479 0.265625 0.70415 0.397227 2026-02-22T22:18:43.850 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 37 16 1492 1476 0.311634 0.28125 0.202656 0.399047 2026-02-22T22:18:44.850 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 38 16 1546 1530 0.314535 0.421875 0.102373 0.395673 2026-02-22T22:18:45.850 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 39 16 1589 1573 0.315083 0.335938 0.502172 0.393912 2026-02-22T22:18:46.851 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:18:46.847300+0000 min lat: 0.0012379 max lat: 1.00358 avg lat: 0.394752 2026-02-22T22:18:46.851 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:18:46.851 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 40 16 1617 1601 0.312674 0.21875 0.400869 0.394752 2026-02-22T22:18:47.851 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 41 16 1661 1645 0.313432 0.34375 0.102342 0.396298 2026-02-22T22:18:48.851 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 42 16 1688 1672 0.310991 0.210938 0.202049 0.39574 2026-02-22T22:18:49.851 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 43 16 1736 1720 0.312479 0.375 0.103706 0.398323 2026-02-22T22:18:50.851 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 44 16 1777 1761 0.312657 0.320312 0.203286 0.396264 2026-02-22T22:18:51.851 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 45 16 1821 1805 0.313347 0.34375 0.202857 0.396376 2026-02-22T22:18:52.851 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 46 16 1862 1846 0.313498 0.320312 0.50293 0.395546 2026-02-22T22:18:53.851 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 47 16 1920 1904 0.316468 0.453125 0.201692 0.393977 2026-02-22T22:18:54.851 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 48 16 1952 1936 0.315083 0.25 0.495848 0.394915 2026-02-22T22:18:55.851 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 49 16 1996 1980 0.315668 0.34375 0.206371 0.394009 2026-02-22T22:18:56.851 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 50 16 2029 2013 0.31451 0.257812 0.201758 0.394989 2026-02-22T22:18:57.851 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 51 16 2082 2066 0.316462 0.414062 0.303545 0.394073 2026-02-22T22:18:58.851 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 52 16 2122 2106 0.316385 0.3125 0.0020431 0.3932 2026-02-22T22:18:59.851 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 53 16 2167 2151 0.317049 0.351562 0.300239 0.392802 2026-02-22T22:19:00.852 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 54 16 2206 2190 0.316819 0.304688 0.401785 0.391562 2026-02-22T22:19:01.852 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 55 16 2227 2211 0.314042 0.164062 0.303312 0.39504 2026-02-22T22:19:02.852 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 56 16 2273 2257 0.314851 0.359375 0.503362 0.394999 2026-02-22T22:19:03.852 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 57 16 2308 2292 0.314124 0.273438 0.50484 0.395377 2026-02-22T22:19:04.852 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 58 16 2348 2332 0.314096 0.3125 0.303265 0.396415 2026-02-22T22:19:05.852 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 59 16 2376 2360 0.312479 0.21875 0.202623 0.397807 2026-02-22T22:19:06.852 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:19:06.848581+0000 min lat: 0.0012379 max lat: 1.30582 avg lat: 0.398424 2026-02-22T22:19:06.852 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:19:06.852 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 60 16 2388 2372 0.308834 0.09375 0.401553 0.398424 2026-02-22T22:19:07.852 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 61 16 2447 2431 0.311327 0.460938 0.202733 0.400613 2026-02-22T22:19:08.852 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 62 16 2476 2460 0.309959 0.226562 0.702278 0.401568 2026-02-22T22:19:09.852 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 63 16 2506 2490 0.308759 0.234375 0.705415 0.402112 2026-02-22T22:19:10.852 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 64 16 2544 2528 0.308573 0.296875 0.305751 0.403846 2026-02-22T22:19:11.852 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 65 16 2576 2560 0.307672 0.25 0.302521 0.404379 2026-02-22T22:19:12.852 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 66 16 2608 2592 0.306798 0.25 0.203071 0.405682 2026-02-22T22:19:13.852 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 67 16 2627 2611 0.304434 0.148438 0.40354 0.408537 2026-02-22T22:19:14.852 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 68 16 2677 2661 0.305702 0.390625 0.502115 0.407979 2026-02-22T22:19:15.853 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 69 16 2707 2691 0.304668 0.234375 0.10133 0.407621 2026-02-22T22:19:16.852 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 70 16 2756 2740 0.305784 0.382812 0.20355 0.407006 2026-02-22T22:19:17.853 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 71 16 2797 2781 0.305988 0.320312 0.499285 0.407312 2026-02-22T22:19:18.853 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 72 16 2848 2832 0.307272 0.398438 0.204976 0.405846 2026-02-22T22:19:19.853 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 73 16 2874 2858 0.305845 0.203125 0.401858 0.407567 2026-02-22T22:19:20.853 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 74 16 2925 2909 0.307096 0.398438 0.502465 0.405999 2026-02-22T22:19:21.853 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 75 16 2955 2939 0.306126 0.234375 0.806333 0.406253 2026-02-22T22:19:22.853 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 76 16 3000 2984 0.306723 0.351562 0.101785 0.406368 2026-02-22T22:19:23.853 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 77 16 3039 3023 0.306697 0.304688 0.402012 0.405884 2026-02-22T22:19:24.853 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 78 16 3065 3049 0.305369 0.203125 0.70224 0.407688 2026-02-22T22:19:25.853 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 79 16 3107 3091 0.305657 0.328125 0.510194 0.407859 2026-02-22T22:19:26.853 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:19:26.849836+0000 min lat: 0.0012379 max lat: 2.31303 avg lat: 0.407965 2026-02-22T22:19:26.854 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:19:26.854 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 80 16 3150 3134 0.306035 0.335938 0.807143 0.407965 2026-02-22T22:19:27.853 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 81 16 3198 3182 0.306886 0.375 0.301915 0.406674 2026-02-22T22:19:28.853 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 82 16 3229 3213 0.306097 0.242188 0.403199 0.407248 2026-02-22T22:19:29.854 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 83 16 3274 3258 0.306644 0.351562 0.101717 0.405813 2026-02-22T22:19:30.854 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 84 16 3317 3301 0.306993 0.335938 0.60305 0.40578 2026-02-22T22:19:31.854 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 85 16 3348 3332 0.30623 0.242188 0.101876 0.406539 2026-02-22T22:19:32.854 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 86 16 3389 3373 0.306394 0.320312 0.101242 0.406756 2026-02-22T22:19:33.854 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 87 16 3433 3417 0.306823 0.34375 0.301563 0.406262 2026-02-22T22:19:34.854 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 88 16 3466 3450 0.306266 0.257812 0.704512 0.406108 2026-02-22T22:19:35.854 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 89 16 3503 3487 0.306072 0.289062 0.102331 0.407126 2026-02-22T22:19:36.854 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 90 16 3549 3533 0.306664 0.359375 0.502624 0.40687 2026-02-22T22:19:37.854 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Total time run: 90.6554 2026-02-22T22:19:37.854 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Total writes made: 3549 2026-02-22T22:19:37.855 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Write size: 8192 2026-02-22T22:19:37.855 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Object size: 65536 2026-02-22T22:19:37.855 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Bandwidth (MB/sec): 0.305846 2026-02-22T22:19:37.855 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Stddev Bandwidth: 0.0668431 2026-02-22T22:19:37.855 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Max bandwidth (MB/sec): 0.460938 2026-02-22T22:19:37.855 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Min bandwidth (MB/sec): 0.09375 2026-02-22T22:19:37.855 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Average IOPS: 39 2026-02-22T22:19:37.855 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Stddev IOPS: 8.55591 2026-02-22T22:19:37.855 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Max IOPS: 59 2026-02-22T22:19:37.855 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Min IOPS: 12 2026-02-22T22:19:37.855 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Average Latency(s): 0.407283 2026-02-22T22:19:37.856 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Stddev Latency(s): 0.203762 2026-02-22T22:19:37.856 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Max latency(s): 2.31303 2026-02-22T22:19:37.856 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Min latency(s): 0.0012379 2026-02-22T22:19:38.156 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Cleaning up (deleting benchmark objects) 2026-02-22T22:19:45.085 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Removed 444 objects 2026-02-22T22:19:45.085 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Clean up completed and total clean up time :6.9289 2026-02-22T22:19:50.545 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2026-02-22T22:19:50.545 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2026-02-22T22:19:50.743 INFO:teuthology.orchestra.run.trial061.stderr:pool 'unique_pool_0' removed 2026-02-22T22:19:50.758 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-22T22:19:50.758 INFO:tasks.radosbench:Beginning radosbench... 2026-02-22T22:19:50.759 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_1 2026-02-22T22:19:50.759 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_1 16 2026-02-22T22:19:51.751 INFO:teuthology.orchestra.run.trial061.stderr:pool 'unique_pool_1' created 2026-02-22T22:19:51.765 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_1 rados --yes-i-really-mean-it || true 2026-02-22T22:19:52.751 INFO:teuthology.orchestra.run.trial061.stderr:enabled application 'rados' on pool 'unique_pool_1' 2026-02-22T22:19:53.767 DEBUG:teuthology.orchestra.run.trial061:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_1 bench 90 write' 2026-02-22T22:19:53.769 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-22T22:19:53.769 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-22T22:19:53.792 INFO:tasks.radosbench.radosbench.0.trial061.stdout:hints = 1 2026-02-22T22:19:53.792 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-22T22:19:53.792 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Object prefix: benchmark_data_trial061_22244 2026-02-22T22:19:53.792 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:19:53.792 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 0 0 0 0 0 0 - 0 2026-02-22T22:19:54.792 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 1 16 51 35 0.273417 0.273438 0.401917 0.334342 2026-02-22T22:19:55.792 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 2 16 106 90 0.351537 0.429688 0.00134134 0.321513 2026-02-22T22:19:56.792 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 3 16 130 114 0.296854 0.1875 0.406522 0.352932 2026-02-22T22:19:57.792 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 4 16 171 155 0.302713 0.320312 0.404209 0.381426 2026-02-22T22:19:58.792 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 5 16 224 208 0.324977 0.414062 0.102817 0.367731 2026-02-22T22:19:59.792 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 6 16 252 236 0.30727 0.21875 0.404179 0.382081 2026-02-22T22:20:00.792 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 7 16 288 272 0.30355 0.28125 0.302451 0.395603 2026-02-22T22:20:01.792 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 8 16 335 319 0.311501 0.367188 0.51417 0.394286 2026-02-22T22:20:02.792 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 9 16 376 360 0.312478 0.320312 0.417256 0.389775 2026-02-22T22:20:03.792 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 10 16 411 395 0.308572 0.273438 0.703181 0.40002 2026-02-22T22:20:04.792 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 11 16 443 427 0.303246 0.25 0.302965 0.404488 2026-02-22T22:20:05.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 12 16 456 440 0.286438 0.101562 0.404811 0.406483 2026-02-22T22:20:06.792 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 13 16 476 460 0.276423 0.15625 0.00304827 0.415248 2026-02-22T22:20:07.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 14 16 515 499 0.278441 0.304688 0.201501 0.441852 2026-02-22T22:20:08.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 15 16 558 542 0.282272 0.335938 0.301272 0.438595 2026-02-22T22:20:09.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 16 16 602 586 0.286113 0.34375 0.603439 0.43231 2026-02-22T22:20:10.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 17 16 644 628 0.288583 0.328125 0.306174 0.429675 2026-02-22T22:20:11.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 18 16 682 666 0.289043 0.296875 0.503146 0.421347 2026-02-22T22:20:12.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 19 16 715 699 0.287398 0.257812 0.506002 0.425163 2026-02-22T22:20:13.792 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:20:13.790375+0000 min lat: 0.00125364 max lat: 2.24538 avg lat: 0.42921 2026-02-22T22:20:13.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:20:13.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 20 16 752 736 0.28748 0.289062 0.511989 0.42921 2026-02-22T22:20:14.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 21 16 791 775 0.288299 0.304688 0.202299 0.430013 2026-02-22T22:20:15.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 22 16 831 815 0.289398 0.3125 0.203472 0.429787 2026-02-22T22:20:16.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 23 16 865 849 0.288363 0.265625 0.50273 0.427621 2026-02-22T22:20:17.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 24 16 900 884 0.287741 0.273438 0.30251 0.429295 2026-02-22T22:20:18.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 25 16 941 925 0.289043 0.320312 0.35038 0.427028 2026-02-22T22:20:19.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 26 16 978 962 0.289043 0.289062 0.501155 0.427308 2026-02-22T22:20:20.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 27 16 1019 1003 0.2902 0.320312 0.50103 0.426492 2026-02-22T22:20:21.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 28 16 1054 1038 0.289601 0.273438 0.202297 0.424937 2026-02-22T22:20:22.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 29 16 1096 1080 0.290929 0.328125 0.302665 0.426846 2026-02-22T22:20:23.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 30 16 1144 1128 0.29373 0.375 0.401457 0.422259 2026-02-22T22:20:24.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 31 16 1181 1165 0.293579 0.289062 0.102921 0.422863 2026-02-22T22:20:25.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 32 16 1221 1205 0.29417 0.3125 0.301316 0.422858 2026-02-22T22:20:26.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 33 16 1266 1250 0.295908 0.351562 0.105457 0.419486 2026-02-22T22:20:27.794 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 34 16 1313 1297 0.298004 0.367188 0.405286 0.417662 2026-02-22T22:20:28.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 35 16 1354 1338 0.298641 0.320312 0.20159 0.416677 2026-02-22T22:20:29.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 36 16 1394 1378 0.299025 0.3125 0.302224 0.416853 2026-02-22T22:20:30.794 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 37 16 1422 1406 0.296855 0.21875 0.201481 0.418161 2026-02-22T22:20:31.794 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 38 16 1459 1443 0.296649 0.289062 0.261392 0.418672 2026-02-22T22:20:32.793 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 39 16 1508 1492 0.298858 0.382812 0.443103 0.4158 2026-02-22T22:20:33.794 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:20:33.791709+0000 min lat: 0.00123225 max lat: 2.24538 avg lat: 0.417314 2026-02-22T22:20:33.794 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:20:33.794 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 40 16 1546 1530 0.298808 0.296875 0.203784 0.417314 2026-02-22T22:20:34.794 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 41 16 1593 1577 0.300475 0.367188 0.202847 0.414211 2026-02-22T22:20:35.794 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 42 16 1635 1619 0.301133 0.328125 0.504991 0.411943 2026-02-22T22:20:36.794 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 43 16 1672 1656 0.300852 0.289062 0.604124 0.413358 2026-02-22T22:20:37.794 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 44 16 1714 1698 0.301471 0.328125 0.399548 0.413215 2026-02-22T22:20:38.794 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 45 16 1755 1739 0.301889 0.320312 0.706916 0.411468 2026-02-22T22:20:39.794 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 46 16 1795 1779 0.30212 0.3125 0.904208 0.412492 2026-02-22T22:20:40.794 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 47 16 1842 1826 0.303503 0.367188 0.297179 0.410138 2026-02-22T22:20:41.794 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 48 16 1883 1867 0.303853 0.320312 0.50229 0.409278 2026-02-22T22:20:42.794 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 49 16 1929 1913 0.304986 0.359375 0.502267 0.407917 2026-02-22T22:20:43.794 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 50 16 1974 1958 0.305917 0.351562 0.301912 0.406229 2026-02-22T22:20:44.794 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 51 16 2017 2001 0.306505 0.335938 0.402088 0.405785 2026-02-22T22:20:45.794 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 52 16 2060 2044 0.307071 0.335938 0.402424 0.40469 2026-02-22T22:20:46.794 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 53 16 2095 2079 0.306436 0.273438 0.505089 0.406396 2026-02-22T22:20:47.794 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 54 16 2138 2122 0.306982 0.335938 0.202485 0.405947 2026-02-22T22:20:48.794 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 55 16 2176 2160 0.306798 0.296875 0.602604 0.405699 2026-02-22T22:20:49.795 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 56 16 2222 2206 0.307736 0.359375 0.301686 0.404495 2026-02-22T22:20:50.795 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 57 16 2265 2249 0.30823 0.335938 0.10245 0.404257 2026-02-22T22:20:51.794 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 58 16 2304 2288 0.308169 0.304688 0.40193 0.403975 2026-02-22T22:20:52.794 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 59 16 2339 2323 0.30758 0.273438 0.00174499 0.405885 2026-02-22T22:20:53.795 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:20:53.793039+0000 min lat: 0.00123225 max lat: 2.24538 avg lat: 0.403632 2026-02-22T22:20:53.795 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:20:53.795 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 60 16 2388 2372 0.308833 0.382812 0.302147 0.403632 2026-02-22T22:20:54.795 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 61 16 2436 2420 0.309918 0.375 0.303033 0.402665 2026-02-22T22:20:55.795 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 62 16 2474 2458 0.309707 0.296875 0.202044 0.40169 2026-02-22T22:20:56.795 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 63 16 2523 2507 0.310867 0.382812 0.204196 0.40095 2026-02-22T22:20:57.795 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 64 16 2563 2547 0.310892 0.3125 0.405635 0.400477 2026-02-22T22:20:58.795 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 65 16 2604 2588 0.311037 0.320312 0.502797 0.400622 2026-02-22T22:20:59.795 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 66 16 2638 2622 0.310348 0.265625 0.00160856 0.40091 2026-02-22T22:21:00.795 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 67 16 2677 2661 0.310264 0.304688 0.202495 0.401428 2026-02-22T22:21:01.795 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 68 16 2710 2694 0.309492 0.257812 0.501455 0.402164 2026-02-22T22:21:02.795 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 69 16 2752 2736 0.309762 0.328125 0.307174 0.402827 2026-02-22T22:21:03.795 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 70 16 2785 2769 0.309019 0.257812 0.402676 0.403679 2026-02-22T22:21:04.796 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 71 16 2813 2797 0.307748 0.21875 0.408986 0.404567 2026-02-22T22:21:05.795 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 72 16 2855 2839 0.308031 0.328125 0.302235 0.404433 2026-02-22T22:21:06.795 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 73 16 2888 2872 0.307342 0.257812 0.40175 0.40525 2026-02-22T22:21:07.796 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 74 16 2935 2919 0.308151 0.367188 0.302434 0.404729 2026-02-22T22:21:08.796 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 75 16 2977 2961 0.308417 0.328125 0.205873 0.404251 2026-02-22T22:21:09.795 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 76 16 3007 2991 0.307442 0.234375 0.402013 0.404359 2026-02-22T22:21:10.796 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 77 16 3034 3018 0.306189 0.210938 0.603121 0.40693 2026-02-22T22:21:11.796 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 78 16 3077 3061 0.30657 0.335938 0.202169 0.406474 2026-02-22T22:21:12.796 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 79 16 3104 3088 0.305359 0.210938 0.801682 0.408119 2026-02-22T22:21:13.796 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:21:13.794376+0000 min lat: 0.00123225 max lat: 2.24538 avg lat: 0.408301 2026-02-22T22:21:13.796 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:21:13.797 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 80 16 3142 3126 0.305253 0.296875 0.302273 0.408301 2026-02-22T22:21:14.796 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 81 16 3180 3164 0.305149 0.296875 0.201764 0.408266 2026-02-22T22:21:15.796 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 82 16 3219 3203 0.305143 0.304688 0.500491 0.408191 2026-02-22T22:21:16.796 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 83 16 3256 3240 0.304949 0.289062 0.402874 0.408575 2026-02-22T22:21:17.796 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 84 16 3298 3282 0.305225 0.328125 0.0012223 0.408161 2026-02-22T22:21:18.796 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 85 16 3343 3327 0.30577 0.351562 0.10287 0.408116 2026-02-22T22:21:19.796 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 86 16 3375 3359 0.305121 0.25 0.303736 0.408184 2026-02-22T22:21:20.796 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 87 16 3421 3405 0.305745 0.359375 0.30376 0.408062 2026-02-22T22:21:21.797 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 88 16 3467 3451 0.306354 0.359375 0.102308 0.4075 2026-02-22T22:21:22.797 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 89 16 3506 3490 0.306335 0.304688 0.10125 0.406956 2026-02-22T22:21:23.796 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 90 16 3536 3520 0.305535 0.234375 0.501387 0.407801 2026-02-22T22:21:24.797 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Total time run: 90.5753 2026-02-22T22:21:24.797 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Total writes made: 3536 2026-02-22T22:21:24.797 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Write size: 8192 2026-02-22T22:21:24.797 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Object size: 65536 2026-02-22T22:21:24.797 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Bandwidth (MB/sec): 0.304995 2026-02-22T22:21:24.797 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Stddev Bandwidth: 0.0541069 2026-02-22T22:21:24.797 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Max bandwidth (MB/sec): 0.429688 2026-02-22T22:21:24.797 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Min bandwidth (MB/sec): 0.101562 2026-02-22T22:21:24.797 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Average IOPS: 39 2026-02-22T22:21:24.797 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Stddev IOPS: 6.92568 2026-02-22T22:21:24.797 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Max IOPS: 55 2026-02-22T22:21:24.797 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Min IOPS: 13 2026-02-22T22:21:24.797 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Average Latency(s): 0.408849 2026-02-22T22:21:24.797 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Stddev Latency(s): 0.204358 2026-02-22T22:21:24.797 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Max latency(s): 2.24538 2026-02-22T22:21:24.797 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Min latency(s): 0.0012223 2026-02-22T22:21:24.798 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Cleaning up (deleting benchmark objects) 2026-02-22T22:21:31.935 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Removed 442 objects 2026-02-22T22:21:31.935 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Clean up completed and total clean up time :7.13653 2026-02-22T22:21:37.491 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_1 2026-02-22T22:21:37.492 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_1 unique_pool_1 --yes-i-really-really-mean-it 2026-02-22T22:21:38.012 INFO:teuthology.orchestra.run.trial061.stderr:pool 'unique_pool_1' removed 2026-02-22T22:21:38.026 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-22T22:21:38.027 INFO:tasks.radosbench:Beginning radosbench... 2026-02-22T22:21:38.027 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_2 2026-02-22T22:21:38.027 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_2 16 2026-02-22T22:21:39.016 INFO:teuthology.orchestra.run.trial061.stderr:pool 'unique_pool_2' created 2026-02-22T22:21:39.030 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_2 rados --yes-i-really-mean-it || true 2026-02-22T22:21:40.022 INFO:teuthology.orchestra.run.trial061.stderr:enabled application 'rados' on pool 'unique_pool_2' 2026-02-22T22:21:41.037 DEBUG:teuthology.orchestra.run.trial061:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_2 bench 90 write' 2026-02-22T22:21:41.038 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-22T22:21:41.038 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-22T22:21:41.062 INFO:tasks.radosbench.radosbench.0.trial061.stdout:hints = 1 2026-02-22T22:21:41.062 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-22T22:21:41.063 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Object prefix: benchmark_data_trial061_22350 2026-02-22T22:21:41.063 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:21:41.063 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 0 0 0 0 0 0 - 0 2026-02-22T22:21:42.063 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 1 16 39 23 0.179673 0.179688 0.203847 0.492188 2026-02-22T22:21:43.063 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 2 16 73 57 0.222639 0.265625 0.302343 0.490837 2026-02-22T22:21:44.063 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 3 16 105 89 0.231754 0.25 0.404884 0.482787 2026-02-22T22:21:45.063 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 4 16 145 129 0.251935 0.3125 0.403595 0.451442 2026-02-22T22:21:46.063 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 5 16 196 180 0.281229 0.398438 0.203333 0.431752 2026-02-22T22:21:47.063 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 6 16 233 217 0.282532 0.289062 0.303191 0.420642 2026-02-22T22:21:48.063 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 7 16 266 250 0.278998 0.257812 0.604173 0.423851 2026-02-22T22:21:49.063 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 8 16 304 288 0.28123 0.296875 0.302911 0.434526 2026-02-22T22:21:50.063 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 9 16 339 323 0.280362 0.273438 0.299058 0.431752 2026-02-22T22:21:51.064 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 10 16 387 371 0.289823 0.375 0.302849 0.422575 2026-02-22T22:21:52.064 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 11 16 427 411 0.291883 0.3125 0.402727 0.417858 2026-02-22T22:21:53.064 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 12 16 466 450 0.292948 0.304688 0.301927 0.422951 2026-02-22T22:21:54.064 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 13 16 502 486 0.292047 0.28125 0.101604 0.420374 2026-02-22T22:21:55.064 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 14 16 548 532 0.296855 0.359375 0.402632 0.41886 2026-02-22T22:21:56.064 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 15 16 576 560 0.291647 0.21875 1.00709 0.414623 2026-02-22T22:21:57.064 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 16 16 613 597 0.291484 0.289062 0.302142 0.424757 2026-02-22T22:21:58.064 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 17 16 655 639 0.293638 0.328125 0.00120975 0.413482 2026-02-22T22:21:59.064 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 18 16 704 688 0.298591 0.382812 0.209543 0.414546 2026-02-22T22:22:00.064 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 19 16 746 730 0.300144 0.328125 0.00143357 0.409954 2026-02-22T22:22:01.064 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:22:01.062544+0000 min lat: 0.00110053 max lat: 1.1073 avg lat: 0.40656 2026-02-22T22:22:01.064 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:22:01.064 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 20 16 789 773 0.301932 0.335938 0.404674 0.40656 2026-02-22T22:22:02.064 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 21 16 817 801 0.297971 0.21875 0.602412 0.410361 2026-02-22T22:22:03.064 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 22 16 860 844 0.299695 0.335938 0.102856 0.413147 2026-02-22T22:22:04.064 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 23 16 906 890 0.302289 0.359375 0.203403 0.411955 2026-02-22T22:22:05.064 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 24 16 935 919 0.299133 0.226562 0.201382 0.410063 2026-02-22T22:22:06.065 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 25 16 982 966 0.301854 0.367188 0.00165289 0.411845 2026-02-22T22:22:07.065 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 26 16 1020 1004 0.301663 0.296875 0.201836 0.411608 2026-02-22T22:22:08.064 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 27 16 1053 1037 0.300038 0.257812 0.102141 0.410969 2026-02-22T22:22:09.065 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 28 16 1088 1072 0.299087 0.273438 0.302616 0.413586 2026-02-22T22:22:10.065 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 29 16 1119 1103 0.297125 0.242188 0.405723 0.417215 2026-02-22T22:22:11.065 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 30 16 1162 1146 0.298418 0.335938 0.00143387 0.415841 2026-02-22T22:22:12.065 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 31 16 1211 1195 0.301139 0.382812 0.101784 0.413035 2026-02-22T22:22:13.065 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 32 16 1238 1222 0.29832 0.210938 0.40275 0.415037 2026-02-22T22:22:14.065 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 33 16 1280 1264 0.299222 0.328125 0.501118 0.414006 2026-02-22T22:22:15.065 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 34 16 1334 1318 0.302829 0.421875 0.302512 0.409962 2026-02-22T22:22:16.065 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 35 16 1370 1354 0.302212 0.28125 0.406317 0.410655 2026-02-22T22:22:17.065 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 36 16 1409 1393 0.30228 0.304688 0.400296 0.410062 2026-02-22T22:22:18.065 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 37 16 1437 1421 0.300022 0.21875 0.100597 0.41402 2026-02-22T22:22:19.066 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 38 16 1480 1464 0.300967 0.335938 0.304106 0.414099 2026-02-22T22:22:20.066 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 39 16 1520 1504 0.301262 0.3125 0.302185 0.412987 2026-02-22T22:22:21.065 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:22:21.063832+0000 min lat: 0.00110053 max lat: 1.20334 avg lat: 0.413132 2026-02-22T22:22:21.065 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:22:21.066 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 40 16 1556 1540 0.300761 0.28125 0.206481 0.413132 2026-02-22T22:22:22.066 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 41 16 1603 1587 0.302381 0.367188 0.404146 0.412087 2026-02-22T22:22:23.066 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 42 16 1637 1621 0.301505 0.265625 0.104847 0.411936 2026-02-22T22:22:24.066 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 43 16 1675 1659 0.301397 0.296875 0.0979083 0.412433 2026-02-22T22:22:25.066 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 44 16 1716 1700 0.301827 0.320312 0.300878 0.412438 2026-02-22T22:22:26.066 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 45 16 1758 1742 0.30241 0.328125 0.300282 0.411501 2026-02-22T22:22:27.066 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 46 16 1790 1774 0.301271 0.25 0.101701 0.412236 2026-02-22T22:22:28.066 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 47 16 1836 1820 0.302507 0.359375 0.302768 0.411233 2026-02-22T22:22:29.066 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 48 16 1871 1855 0.301901 0.273438 0.305293 0.412521 2026-02-22T22:22:30.066 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 49 16 1908 1892 0.301638 0.289062 0.201605 0.412477 2026-02-22T22:22:31.066 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 50 16 1947 1931 0.301699 0.304688 0.403323 0.411403 2026-02-22T22:22:32.066 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 51 16 1985 1969 0.301604 0.296875 0.504803 0.413305 2026-02-22T22:22:33.066 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 52 16 2009 1993 0.299409 0.1875 0.700523 0.414722 2026-02-22T22:22:34.067 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 53 16 2051 2035 0.299951 0.328125 0.302621 0.41499 2026-02-22T22:22:35.067 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 54 16 2087 2071 0.299604 0.28125 0.204205 0.415845 2026-02-22T22:22:36.067 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 55 16 2128 2112 0.29998 0.320312 0.204803 0.415176 2026-02-22T22:22:37.067 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 56 16 2166 2150 0.299924 0.296875 0.305 0.414907 2026-02-22T22:22:38.067 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 57 16 2219 2203 0.301926 0.414062 0.305686 0.41239 2026-02-22T22:22:39.067 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 58 16 2256 2240 0.301704 0.289062 0.497767 0.412938 2026-02-22T22:22:40.067 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 59 16 2297 2281 0.302019 0.320312 0.204537 0.412403 2026-02-22T22:22:41.067 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:22:41.065154+0000 min lat: 0.00110053 max lat: 1.20334 avg lat: 0.411578 2026-02-22T22:22:41.067 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:22:41.067 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 60 16 2339 2323 0.302454 0.328125 0.201719 0.411578 2026-02-22T22:22:42.067 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 61 16 2383 2367 0.30313 0.34375 0.303132 0.411395 2026-02-22T22:22:43.067 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 62 16 2413 2397 0.302021 0.234375 0.102982 0.411624 2026-02-22T22:22:44.067 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 63 16 2459 2443 0.302931 0.359375 0.303189 0.410252 2026-02-22T22:22:45.067 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 64 16 2503 2487 0.303569 0.34375 0.202844 0.410006 2026-02-22T22:22:46.067 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 65 16 2542 2526 0.303586 0.304688 0.301714 0.410391 2026-02-22T22:22:47.067 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 66 16 2584 2568 0.303957 0.328125 0.507935 0.409694 2026-02-22T22:22:48.068 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 67 16 2625 2609 0.304201 0.320312 0.603449 0.409756 2026-02-22T22:22:49.068 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 68 16 2650 2634 0.302599 0.195312 0.00121352 0.410694 2026-02-22T22:22:50.068 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 69 16 2694 2678 0.303195 0.34375 0.608394 0.411294 2026-02-22T22:22:51.068 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 70 16 2728 2712 0.302659 0.265625 0.102463 0.411451 2026-02-22T22:22:52.068 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 71 16 2762 2746 0.302137 0.265625 0.403227 0.412505 2026-02-22T22:22:53.068 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 72 16 2796 2780 0.301629 0.265625 0.405106 0.412841 2026-02-22T22:22:54.068 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 73 16 2836 2820 0.301778 0.3125 0.402009 0.412711 2026-02-22T22:22:55.068 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 74 16 2883 2867 0.302662 0.367188 0.205337 0.412153 2026-02-22T22:22:56.068 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 75 16 2926 2910 0.303105 0.335938 0.402116 0.410971 2026-02-22T22:22:57.068 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 76 16 2980 2964 0.304667 0.421875 0.206557 0.40924 2026-02-22T22:22:58.068 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 77 16 3018 3002 0.304566 0.296875 0.201689 0.408904 2026-02-22T22:22:59.068 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 78 16 3052 3036 0.304066 0.265625 0.00199773 0.409167 2026-02-22T22:23:00.068 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 79 16 3081 3065 0.303085 0.226562 0.595418 0.410205 2026-02-22T22:23:01.069 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:23:01.066469+0000 min lat: 0.00108967 max lat: 1.20334 avg lat: 0.409541 2026-02-22T22:23:01.069 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:23:01.069 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 80 16 3134 3118 0.304472 0.414062 0.444464 0.409541 2026-02-22T22:23:02.069 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 81 16 3177 3161 0.30486 0.335938 0.304664 0.409091 2026-02-22T22:23:03.069 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 82 16 3203 3187 0.303619 0.203125 0.403676 0.410107 2026-02-22T22:23:04.069 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 83 16 3244 3228 0.30382 0.320312 0.404922 0.410328 2026-02-22T22:23:05.069 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 84 16 3281 3265 0.303644 0.289062 0.402328 0.41036 2026-02-22T22:23:06.069 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 85 16 3318 3302 0.303473 0.289062 0.200556 0.41017 2026-02-22T22:23:07.069 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 86 16 3347 3331 0.302578 0.226562 0.504896 0.411495 2026-02-22T22:23:08.069 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 87 16 3393 3377 0.303231 0.359375 0.200999 0.410963 2026-02-22T22:23:09.069 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 88 16 3439 3423 0.303868 0.359375 0.102019 0.410356 2026-02-22T22:23:10.069 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 89 16 3464 3448 0.302648 0.195312 0.402166 0.411372 2026-02-22T22:23:11.069 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 90 16 3514 3498 0.303626 0.390625 0.304672 0.41142 2026-02-22T22:23:12.069 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Total time run: 90.4934 2026-02-22T22:23:12.069 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Total writes made: 3514 2026-02-22T22:23:12.069 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Write size: 8192 2026-02-22T22:23:12.069 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Object size: 65536 2026-02-22T22:23:12.070 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Bandwidth (MB/sec): 0.303372 2026-02-22T22:23:12.070 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Stddev Bandwidth: 0.0559115 2026-02-22T22:23:12.070 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Max bandwidth (MB/sec): 0.421875 2026-02-22T22:23:12.070 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Min bandwidth (MB/sec): 0.179688 2026-02-22T22:23:12.070 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Average IOPS: 38 2026-02-22T22:23:12.070 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Stddev IOPS: 7.15667 2026-02-22T22:23:12.070 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Max IOPS: 54 2026-02-22T22:23:12.070 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Min IOPS: 23 2026-02-22T22:23:12.070 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Average Latency(s): 0.411208 2026-02-22T22:23:12.070 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Stddev Latency(s): 0.193463 2026-02-22T22:23:12.070 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Max latency(s): 1.20334 2026-02-22T22:23:12.070 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Min latency(s): 0.00108967 2026-02-22T22:23:12.271 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Cleaning up (deleting benchmark objects) 2026-02-22T22:23:19.303 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Removed 440 objects 2026-02-22T22:23:19.303 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Clean up completed and total clean up time :7.03136 2026-02-22T22:23:24.761 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_2 2026-02-22T22:23:24.761 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_2 unique_pool_2 --yes-i-really-really-mean-it 2026-02-22T22:23:24.964 INFO:teuthology.orchestra.run.trial061.stderr:pool 'unique_pool_2' removed 2026-02-22T22:23:24.977 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-22T22:23:24.977 INFO:tasks.radosbench:Beginning radosbench... 2026-02-22T22:23:24.977 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_3 2026-02-22T22:23:24.978 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_3 16 2026-02-22T22:23:25.988 INFO:teuthology.orchestra.run.trial061.stderr:pool 'unique_pool_3' created 2026-02-22T22:23:26.003 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_3 rados --yes-i-really-mean-it || true 2026-02-22T22:23:26.992 INFO:teuthology.orchestra.run.trial061.stderr:enabled application 'rados' on pool 'unique_pool_3' 2026-02-22T22:23:28.006 DEBUG:teuthology.orchestra.run.trial061:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_3 bench 90 write' 2026-02-22T22:23:28.008 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-22T22:23:28.008 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-22T22:23:28.033 INFO:tasks.radosbench.radosbench.0.trial061.stdout:hints = 1 2026-02-22T22:23:28.033 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-22T22:23:28.033 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Object prefix: benchmark_data_trial061_22679 2026-02-22T22:23:28.033 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:23:28.034 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 0 0 0 0 0 0 - 0 2026-02-22T22:23:29.033 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 1 16 51 35 0.273416 0.273438 0.20255 0.337698 2026-02-22T22:23:30.033 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 2 16 95 79 0.308571 0.34375 0.402507 0.340797 2026-02-22T22:23:31.033 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 3 16 147 131 0.341122 0.40625 0.703876 0.338356 2026-02-22T22:23:32.033 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 4 16 199 183 0.357397 0.40625 0.29963 0.3343 2026-02-22T22:23:33.033 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 5 16 234 218 0.340601 0.273438 0.101439 0.338732 2026-02-22T22:23:34.033 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 6 16 284 268 0.348934 0.390625 0.201552 0.347787 2026-02-22T22:23:35.033 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 7 16 330 314 0.350422 0.359375 0.00128806 0.347951 2026-02-22T22:23:36.034 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 8 16 370 354 0.34568 0.3125 0.30125 0.353015 2026-02-22T22:23:37.034 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 9 16 413 397 0.344595 0.335938 0.202355 0.355349 2026-02-22T22:23:38.034 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 10 16 460 444 0.346852 0.367188 0.303276 0.35493 2026-02-22T22:23:39.034 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 11 16 512 496 0.352249 0.40625 0.203088 0.349866 2026-02-22T22:23:40.034 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 12 16 551 535 0.348284 0.304688 0.302797 0.354687 2026-02-22T22:23:41.034 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 13 16 596 580 0.348534 0.351562 0.303885 0.357001 2026-02-22T22:23:42.034 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 14 16 625 609 0.339821 0.226562 0.502325 0.360948 2026-02-22T22:23:43.034 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 15 16 663 647 0.336957 0.296875 0.301474 0.363848 2026-02-22T22:23:44.034 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 16 16 707 691 0.33738 0.34375 0.203243 0.364813 2026-02-22T22:23:45.034 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 17 16 752 736 0.338213 0.351562 0.604764 0.365107 2026-02-22T22:23:46.034 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 18 16 787 771 0.334613 0.273438 0.402842 0.369393 2026-02-22T22:23:47.034 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 19 16 823 807 0.331804 0.28125 0.403206 0.370446 2026-02-22T22:23:48.034 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:23:48.032046+0000 min lat: 0.00109433 max lat: 0.906634 avg lat: 0.366382 2026-02-22T22:23:48.035 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:23:48.035 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 20 16 876 860 0.335915 0.414062 0.203635 0.366382 2026-02-22T22:23:49.034 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 21 16 916 900 0.334799 0.3125 0.00108989 0.367537 2026-02-22T22:23:50.035 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 22 16 946 930 0.330234 0.234375 0.206277 0.369311 2026-02-22T22:23:51.035 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 23 16 977 961 0.326405 0.242188 0.405218 0.375735 2026-02-22T22:23:52.035 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 24 16 1013 997 0.324523 0.28125 0.203013 0.381875 2026-02-22T22:23:53.035 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 25 16 1061 1045 0.326541 0.375 0.40352 0.38014 2026-02-22T22:23:54.035 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 26 16 1099 1083 0.325399 0.296875 0.202031 0.381285 2026-02-22T22:23:55.035 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 27 16 1147 1131 0.327235 0.375 0.203756 0.380533 2026-02-22T22:23:56.035 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 28 16 1174 1158 0.323081 0.210938 0.805987 0.384112 2026-02-22T22:23:57.035 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 29 16 1209 1193 0.321369 0.273438 0.201824 0.386149 2026-02-22T22:23:58.035 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 30 15 1256 1241 0.323156 0.375 0.299337 0.38495 2026-02-22T22:23:59.035 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 31 16 1288 1272 0.320543 0.242188 0.40575 0.385138 2026-02-22T22:24:00.035 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 32 16 1333 1317 0.321512 0.351562 0.548266 0.385576 2026-02-22T22:24:01.035 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 33 16 1378 1362 0.322422 0.351562 0.403198 0.384546 2026-02-22T22:24:02.035 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 34 16 1406 1390 0.319372 0.21875 0.701998 0.386794 2026-02-22T22:24:03.035 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 35 16 1458 1442 0.321854 0.40625 0.00144415 0.386658 2026-02-22T22:24:04.035 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 36 16 1497 1481 0.321376 0.304688 0.602404 0.386856 2026-02-22T22:24:05.036 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 37 16 1539 1523 0.321558 0.328125 0.202355 0.386967 2026-02-22T22:24:06.036 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 38 16 1584 1568 0.322347 0.351562 0.203694 0.385302 2026-02-22T22:24:07.036 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 39 16 1639 1623 0.325099 0.429688 0.201677 0.383526 2026-02-22T22:24:08.036 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:24:08.033363+0000 min lat: 0.00108989 max lat: 1.4099 avg lat: 0.383929 2026-02-22T22:24:08.036 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:24:08.036 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 40 16 1676 1660 0.324197 0.289062 0.401354 0.383929 2026-02-22T22:24:09.036 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 41 16 1715 1699 0.323721 0.304688 0.0966104 0.383466 2026-02-22T22:24:10.036 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 42 16 1767 1751 0.325685 0.40625 0.504024 0.381718 2026-02-22T22:24:11.036 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 43 16 1807 1791 0.325378 0.3125 0.101632 0.382067 2026-02-22T22:24:12.036 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 44 16 1844 1828 0.324552 0.289062 0.202835 0.383915 2026-02-22T22:24:13.036 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 45 16 1881 1865 0.323763 0.289062 0.502937 0.383654 2026-02-22T22:24:14.036 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 46 16 1924 1908 0.324027 0.335938 0.00161367 0.384182 2026-02-22T22:24:15.036 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 47 16 1963 1947 0.323615 0.304688 0.300844 0.383985 2026-02-22T22:24:16.036 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 48 16 1995 1979 0.322081 0.25 0.201995 0.385289 2026-02-22T22:24:17.036 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 49 16 2030 2014 0.321088 0.273438 0.403918 0.387056 2026-02-22T22:24:18.037 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 50 16 2068 2052 0.320604 0.296875 0.301284 0.387947 2026-02-22T22:24:19.037 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 51 16 2117 2101 0.321823 0.382812 0.00240925 0.386866 2026-02-22T22:24:20.037 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 52 16 2164 2148 0.322695 0.367188 0.303202 0.386562 2026-02-22T22:24:21.036 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 53 16 2201 2185 0.32206 0.289062 0.502197 0.386027 2026-02-22T22:24:22.037 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 54 16 2241 2225 0.321883 0.3125 0.203567 0.387126 2026-02-22T22:24:23.037 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 55 16 2296 2280 0.323842 0.429688 0.00211349 0.385351 2026-02-22T22:24:24.037 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 56 16 2334 2318 0.32336 0.296875 0.403345 0.384607 2026-02-22T22:24:25.037 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 57 16 2385 2369 0.324677 0.398438 0.51132 0.383479 2026-02-22T22:24:26.037 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 58 16 2434 2418 0.325679 0.382812 0.302439 0.383167 2026-02-22T22:24:27.037 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 59 16 2477 2461 0.325852 0.335938 0.102649 0.382652 2026-02-22T22:24:28.037 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:24:28.034700+0000 min lat: 0.00101435 max lat: 1.4099 avg lat: 0.38299 2026-02-22T22:24:28.038 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:24:28.038 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 60 16 2512 2496 0.324978 0.273438 0.403757 0.38299 2026-02-22T22:24:29.037 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 61 16 2552 2536 0.324773 0.3125 0.401691 0.382197 2026-02-22T22:24:30.037 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 62 16 2589 2573 0.324197 0.289062 0.101265 0.38385 2026-02-22T22:24:31.038 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 63 16 2619 2603 0.322771 0.234375 0.902349 0.384829 2026-02-22T22:24:32.038 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 64 16 2651 2635 0.321634 0.25 0.704505 0.386448 2026-02-22T22:24:33.038 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 65 16 2685 2669 0.320772 0.265625 0.60453 0.388346 2026-02-22T22:24:34.038 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 66 16 2719 2703 0.319936 0.265625 0.302666 0.388741 2026-02-22T22:24:35.038 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 67 16 2755 2739 0.319358 0.28125 0.607273 0.388752 2026-02-22T22:24:36.038 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 68 16 2795 2779 0.319257 0.3125 0.403533 0.390691 2026-02-22T22:24:37.038 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 69 16 2832 2816 0.318819 0.289062 0.502086 0.390696 2026-02-22T22:24:38.038 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 70 16 2886 2870 0.320291 0.421875 0.102615 0.389344 2026-02-22T22:24:39.038 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 71 16 2928 2912 0.320401 0.328125 0.403528 0.38885 2026-02-22T22:24:40.038 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 72 16 2969 2953 0.3204 0.320312 0.303915 0.388623 2026-02-22T22:24:41.038 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 73 16 3008 2992 0.320184 0.304688 0.608651 0.389831 2026-02-22T22:24:42.038 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 74 16 3051 3035 0.320397 0.335938 0.40315 0.388702 2026-02-22T22:24:43.038 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 75 16 3085 3069 0.319666 0.265625 0.201801 0.38929 2026-02-22T22:24:44.038 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 76 16 3127 3111 0.319777 0.328125 0.305207 0.388923 2026-02-22T22:24:45.038 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 77 16 3182 3166 0.321204 0.429688 0.301345 0.388501 2026-02-22T22:24:46.039 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 78 16 3220 3204 0.320892 0.296875 0.201079 0.388197 2026-02-22T22:24:47.039 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 79 16 3270 3254 0.321774 0.390625 0.400663 0.38762 2026-02-22T22:24:48.039 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:24:48.036043+0000 min lat: 0.00101435 max lat: 1.4099 avg lat: 0.38666 2026-02-22T22:24:48.039 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:24:48.039 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 80 16 3314 3298 0.322049 0.34375 0.202783 0.38666 2026-02-22T22:24:49.039 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 81 16 3354 3338 0.321931 0.3125 0.50086 0.386502 2026-02-22T22:24:50.039 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 82 16 3385 3369 0.320958 0.242188 0.103754 0.388128 2026-02-22T22:24:51.039 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 83 16 3428 3412 0.321138 0.335938 0.302316 0.388048 2026-02-22T22:24:52.039 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 84 16 3473 3457 0.3215 0.351562 0.507011 0.388367 2026-02-22T22:24:53.039 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 85 16 3510 3494 0.321118 0.289062 0.203511 0.388947 2026-02-22T22:24:54.039 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 86 16 3552 3536 0.321199 0.328125 0.603579 0.388095 2026-02-22T22:24:55.039 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 87 16 3593 3577 0.321189 0.320312 0.402423 0.388262 2026-02-22T22:24:56.039 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 88 16 3640 3624 0.321711 0.367188 0.303507 0.387628 2026-02-22T22:24:57.039 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 89 16 3674 3658 0.321081 0.265625 0.201486 0.388329 2026-02-22T22:24:58.039 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 90 16 3720 3704 0.321506 0.359375 0.302947 0.387971 2026-02-22T22:24:59.039 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Total time run: 90.7188 2026-02-22T22:24:59.039 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Total writes made: 3720 2026-02-22T22:24:59.039 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Write size: 8192 2026-02-22T22:24:59.039 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Object size: 65536 2026-02-22T22:24:59.040 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Bandwidth (MB/sec): 0.320358 2026-02-22T22:24:59.040 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Stddev Bandwidth: 0.0538587 2026-02-22T22:24:59.040 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Max bandwidth (MB/sec): 0.429688 2026-02-22T22:24:59.040 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Min bandwidth (MB/sec): 0.210938 2026-02-22T22:24:59.040 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Average IOPS: 41 2026-02-22T22:24:59.040 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Stddev IOPS: 6.89392 2026-02-22T22:24:59.040 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Max IOPS: 55 2026-02-22T22:24:59.040 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Min IOPS: 27 2026-02-22T22:24:59.040 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Average Latency(s): 0.388813 2026-02-22T22:24:59.040 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Stddev Latency(s): 0.18449 2026-02-22T22:24:59.040 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Max latency(s): 1.4099 2026-02-22T22:24:59.040 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Min latency(s): 0.00101435 2026-02-22T22:24:59.041 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Cleaning up (deleting benchmark objects) 2026-02-22T22:25:05.479 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Removed 465 objects 2026-02-22T22:25:05.479 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Clean up completed and total clean up time :6.43732 2026-02-22T22:25:05.629 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_3 2026-02-22T22:25:05.629 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_3 unique_pool_3 --yes-i-really-really-mean-it 2026-02-22T22:25:06.028 INFO:teuthology.orchestra.run.trial061.stderr:pool 'unique_pool_3' removed 2026-02-22T22:25:06.040 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-22T22:25:06.041 INFO:tasks.radosbench:Beginning radosbench... 2026-02-22T22:25:06.041 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_4 2026-02-22T22:25:06.041 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_4 16 2026-02-22T22:25:07.036 INFO:teuthology.orchestra.run.trial061.stderr:pool 'unique_pool_4' created 2026-02-22T22:25:07.049 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_4 rados --yes-i-really-mean-it || true 2026-02-22T22:25:08.036 INFO:teuthology.orchestra.run.trial061.stderr:enabled application 'rados' on pool 'unique_pool_4' 2026-02-22T22:25:09.052 DEBUG:teuthology.orchestra.run.trial061:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_4 bench 90 write' 2026-02-22T22:25:09.054 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-22T22:25:09.054 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-22T22:25:09.079 INFO:tasks.radosbench.radosbench.0.trial061.stdout:hints = 1 2026-02-22T22:25:09.079 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-22T22:25:09.079 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Object prefix: benchmark_data_trial061_22788 2026-02-22T22:25:09.079 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:25:09.079 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 0 0 0 0 0 0 - 0 2026-02-22T22:25:10.079 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 1 16 50 34 0.265602 0.265625 0.169988 0.402847 2026-02-22T22:25:11.079 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 2 16 97 81 0.316382 0.367188 0.303928 0.343172 2026-02-22T22:25:12.079 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 3 16 146 130 0.338516 0.382812 0.101367 0.352559 2026-02-22T22:25:13.079 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 4 16 181 165 0.322242 0.273438 0.303757 0.355901 2026-02-22T22:25:14.079 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 5 16 219 203 0.317165 0.296875 0.202088 0.369125 2026-02-22T22:25:15.079 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 6 16 271 255 0.332008 0.40625 0.406772 0.363479 2026-02-22T22:25:16.079 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 7 16 323 307 0.34261 0.40625 0.244846 0.353318 2026-02-22T22:25:17.079 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 8 16 363 347 0.338844 0.3125 0.215878 0.352641 2026-02-22T22:25:18.079 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 9 16 408 392 0.340254 0.351562 0.318093 0.359515 2026-02-22T22:25:19.079 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 10 16 446 430 0.335914 0.296875 0.101697 0.356311 2026-02-22T22:25:20.080 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 11 16 495 479 0.340175 0.382812 0.303223 0.359189 2026-02-22T22:25:21.079 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 12 16 542 526 0.342424 0.367188 0.202903 0.359918 2026-02-22T22:25:22.080 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 13 16 575 559 0.335915 0.257812 0.501349 0.358151 2026-02-22T22:25:23.080 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 14 16 631 615 0.343169 0.4375 0.404416 0.36069 2026-02-22T22:25:24.080 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 15 16 663 647 0.336956 0.25 0.507721 0.362316 2026-02-22T22:25:25.080 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 16 16 701 685 0.33445 0.296875 0.202564 0.36841 2026-02-22T22:25:26.080 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 17 16 746 730 0.335455 0.351562 0.00159087 0.369627 2026-02-22T22:25:27.080 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 18 16 787 771 0.334613 0.320312 0.101559 0.36758 2026-02-22T22:25:28.080 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 19 16 832 816 0.335504 0.351562 0.305842 0.369422 2026-02-22T22:25:29.080 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:25:29.077325+0000 min lat: 0.00123251 max lat: 1.00617 avg lat: 0.369414 2026-02-22T22:25:29.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:25:29.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 20 16 879 863 0.337087 0.367188 0.106038 0.369414 2026-02-22T22:25:30.080 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 21 16 933 917 0.341123 0.421875 0.102255 0.364603 2026-02-22T22:25:31.080 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 22 16 962 946 0.335915 0.226562 0.00155734 0.365377 2026-02-22T22:25:32.080 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 23 16 997 981 0.333198 0.273438 0.102347 0.370354 2026-02-22T22:25:33.080 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 24 16 1037 1021 0.332334 0.3125 0.563401 0.371504 2026-02-22T22:25:34.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 25 16 1081 1065 0.33279 0.34375 0.201724 0.371704 2026-02-22T22:25:35.080 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 26 16 1126 1110 0.333511 0.351562 0.504403 0.371627 2026-02-22T22:25:36.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 27 16 1167 1151 0.333022 0.320312 0.201198 0.3721 2026-02-22T22:25:37.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 28 16 1214 1198 0.334241 0.367188 0.304263 0.371119 2026-02-22T22:25:38.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 29 16 1255 1239 0.33376 0.320312 0.00223219 0.371483 2026-02-22T22:25:39.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 30 16 1302 1286 0.334873 0.367188 0.204442 0.370055 2026-02-22T22:25:40.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 31 16 1331 1315 0.331379 0.226562 0.202625 0.374588 2026-02-22T22:25:41.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 32 16 1380 1364 0.332985 0.382812 0.201598 0.373253 2026-02-22T22:25:42.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 33 16 1429 1413 0.334495 0.382812 0.203582 0.372405 2026-02-22T22:25:43.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 34 16 1481 1465 0.336604 0.40625 0.202307 0.369736 2026-02-22T22:25:44.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 35 16 1515 1499 0.334576 0.265625 0.603493 0.369909 2026-02-22T22:25:45.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 36 16 1551 1535 0.333094 0.28125 0.305727 0.371738 2026-02-22T22:25:46.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 37 16 1589 1573 0.332114 0.296875 0.403177 0.373515 2026-02-22T22:25:47.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 38 16 1632 1616 0.332215 0.335938 0.401809 0.373425 2026-02-22T22:25:48.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 39 16 1679 1663 0.333111 0.367188 0.506597 0.372629 2026-02-22T22:25:49.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:25:49.078663+0000 min lat: 0.00123251 max lat: 1.00617 avg lat: 0.374903 2026-02-22T22:25:49.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:25:49.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 40 16 1714 1698 0.331618 0.273438 0.402087 0.374903 2026-02-22T22:25:50.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 41 16 1764 1748 0.333057 0.390625 0.203063 0.374724 2026-02-22T22:25:51.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 42 16 1799 1783 0.331637 0.273438 0.802177 0.375782 2026-02-22T22:25:52.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 43 16 1819 1803 0.327558 0.15625 0.200911 0.377849 2026-02-22T22:25:53.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 44 16 1866 1850 0.328458 0.367188 0.397841 0.378961 2026-02-22T22:25:54.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 45 16 1907 1891 0.328277 0.320312 0.606365 0.378906 2026-02-22T22:25:55.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 46 16 1950 1934 0.328443 0.335938 0.405097 0.378072 2026-02-22T22:25:56.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 47 16 1992 1976 0.328435 0.328125 0.405783 0.378492 2026-02-22T22:25:57.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 48 16 2032 2016 0.328103 0.3125 0.20212 0.378718 2026-02-22T22:25:58.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 49 16 2068 2052 0.327146 0.28125 0.00230056 0.37915 2026-02-22T22:25:59.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 50 16 2112 2096 0.327478 0.34375 0.303223 0.379961 2026-02-22T22:26:00.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 51 16 2165 2149 0.329175 0.414062 0.203121 0.378566 2026-02-22T22:26:01.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 52 16 2200 2184 0.328103 0.273438 0.502998 0.37956 2026-02-22T22:26:02.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 53 16 2237 2221 0.327366 0.289062 0.402839 0.380032 2026-02-22T22:26:03.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 54 16 2280 2264 0.327524 0.335938 0.204345 0.380592 2026-02-22T22:26:04.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 55 16 2323 2307 0.327677 0.335938 0.303479 0.3799 2026-02-22T22:26:05.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 56 16 2377 2361 0.329358 0.421875 0.402843 0.378392 2026-02-22T22:26:06.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 57 16 2422 2406 0.329748 0.351562 0.500512 0.378254 2026-02-22T22:26:07.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 58 16 2451 2435 0.327968 0.226562 0.398823 0.377923 2026-02-22T22:26:08.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 59 16 2489 2473 0.327441 0.296875 0.102877 0.380489 2026-02-22T22:26:09.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:26:09.079995+0000 min lat: 0.00123251 max lat: 1.00617 avg lat: 0.379242 2026-02-22T22:26:09.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:26:09.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 60 16 2540 2524 0.328624 0.398438 0.00168885 0.379242 2026-02-22T22:26:10.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 61 16 2589 2573 0.329512 0.382812 0.402819 0.377685 2026-02-22T22:26:11.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 62 16 2632 2616 0.329615 0.335938 0.30507 0.377707 2026-02-22T22:26:12.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 63 16 2674 2658 0.329591 0.328125 0.301893 0.37815 2026-02-22T22:26:13.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 64 16 2716 2700 0.329568 0.328125 0.20261 0.377731 2026-02-22T22:26:14.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 65 16 2761 2745 0.329906 0.351562 0.302303 0.377552 2026-02-22T22:26:15.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 66 16 2814 2798 0.33118 0.414062 0.202235 0.376982 2026-02-22T22:26:16.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 67 16 2856 2840 0.331135 0.328125 0.10152 0.375944 2026-02-22T22:26:17.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 68 16 2902 2886 0.33155 0.359375 0.10168 0.375796 2026-02-22T22:26:18.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 69 16 2921 2905 0.328896 0.148438 0.601754 0.37755 2026-02-22T22:26:19.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 70 16 2967 2951 0.329331 0.359375 0.603973 0.378705 2026-02-22T22:26:20.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 71 16 2994 2978 0.327663 0.210938 0.298897 0.380143 2026-02-22T22:26:21.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 72 16 3022 3006 0.32615 0.21875 0.203345 0.382261 2026-02-22T22:26:22.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 73 16 3072 3056 0.327033 0.390625 0.102562 0.38076 2026-02-22T22:26:23.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 74 16 3117 3101 0.327364 0.351562 0.504363 0.380903 2026-02-22T22:26:24.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 75 16 3153 3137 0.326749 0.28125 0.501842 0.381559 2026-02-22T22:26:25.086 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 76 16 3196 3180 0.32687 0.335938 0.104613 0.380915 2026-02-22T22:26:26.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 77 16 3229 3213 0.325973 0.257812 0.203687 0.382342 2026-02-22T22:26:27.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 78 16 3270 3254 0.3259 0.320312 0.202258 0.382455 2026-02-22T22:26:28.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 79 16 3319 3303 0.32662 0.382812 0.303979 0.381965 2026-02-22T22:26:29.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:26:29.081327+0000 min lat: 0.00123251 max lat: 1.20377 avg lat: 0.38187 2026-02-22T22:26:29.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:26:29.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 80 16 3356 3340 0.32615 0.289062 0.501239 0.38187 2026-02-22T22:26:30.085 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 81 16 3398 3382 0.326174 0.328125 0.403619 0.382364 2026-02-22T22:26:31.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 82 16 3419 3403 0.324197 0.164062 0.400868 0.383917 2026-02-22T22:26:32.085 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 83 16 3458 3442 0.323962 0.304688 0.301076 0.384698 2026-02-22T22:26:33.085 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 84 16 3495 3479 0.323546 0.289062 0.202167 0.385064 2026-02-22T22:26:34.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 85 16 3540 3524 0.323875 0.351562 0.10268 0.385374 2026-02-22T22:26:35.085 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 86 16 3577 3561 0.32347 0.289062 0.399644 0.38513 2026-02-22T22:26:36.085 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 87 16 3616 3600 0.323254 0.304688 0.400261 0.385571 2026-02-22T22:26:37.085 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 88 16 3658 3642 0.323309 0.328125 0.303154 0.38573 2026-02-22T22:26:38.085 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 89 16 3695 3679 0.322924 0.289062 0.10158 0.385684 2026-02-22T22:26:39.085 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 90 16 3747 3731 0.32385 0.40625 0.302479 0.385066 2026-02-22T22:26:40.085 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Total time run: 90.4329 2026-02-22T22:26:40.086 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Total writes made: 3747 2026-02-22T22:26:40.086 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Write size: 8192 2026-02-22T22:26:40.086 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Object size: 65536 2026-02-22T22:26:40.086 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Bandwidth (MB/sec): 0.323703 2026-02-22T22:26:40.086 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Stddev Bandwidth: 0.0600622 2026-02-22T22:26:40.086 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Max bandwidth (MB/sec): 0.4375 2026-02-22T22:26:40.086 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Min bandwidth (MB/sec): 0.148438 2026-02-22T22:26:40.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Average IOPS: 41 2026-02-22T22:26:40.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Stddev IOPS: 7.68796 2026-02-22T22:26:40.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Max IOPS: 56 2026-02-22T22:26:40.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Min IOPS: 19 2026-02-22T22:26:40.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Average Latency(s): 0.385198 2026-02-22T22:26:40.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Stddev Latency(s): 0.185355 2026-02-22T22:26:40.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Max latency(s): 1.20377 2026-02-22T22:26:40.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Min latency(s): 0.00123251 2026-02-22T22:26:40.088 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Cleaning up (deleting benchmark objects) 2026-02-22T22:26:46.730 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Removed 469 objects 2026-02-22T22:26:46.730 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Clean up completed and total clean up time :6.64286 2026-02-22T22:26:52.776 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_4 2026-02-22T22:26:52.777 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_4 unique_pool_4 --yes-i-really-really-mean-it 2026-02-22T22:26:52.983 INFO:teuthology.orchestra.run.trial061.stderr:pool 'unique_pool_4' removed 2026-02-22T22:26:52.995 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-22T22:26:52.995 INFO:tasks.radosbench:Beginning radosbench... 2026-02-22T22:26:52.996 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_5 2026-02-22T22:26:52.996 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_5 16 2026-02-22T22:26:54.010 INFO:teuthology.orchestra.run.trial061.stderr:pool 'unique_pool_5' created 2026-02-22T22:26:54.025 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_5 rados --yes-i-really-mean-it || true 2026-02-22T22:26:55.014 INFO:teuthology.orchestra.run.trial061.stderr:enabled application 'rados' on pool 'unique_pool_5' 2026-02-22T22:26:56.028 DEBUG:teuthology.orchestra.run.trial061:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_5 bench 90 write' 2026-02-22T22:26:56.030 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-22T22:26:56.030 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-22T22:26:56.053 INFO:tasks.radosbench.radosbench.0.trial061.stdout:hints = 1 2026-02-22T22:26:56.053 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-22T22:26:56.053 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Object prefix: benchmark_data_trial061_22906 2026-02-22T22:26:56.054 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:26:56.054 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 0 0 0 0 0 0 - 0 2026-02-22T22:26:57.054 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 1 16 45 29 0.226543 0.226562 0.504582 0.330952 2026-02-22T22:26:58.054 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 2 16 85 69 0.269511 0.3125 0.202223 0.414868 2026-02-22T22:26:59.054 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 3 16 135 119 0.309873 0.390625 0.405245 0.382147 2026-02-22T22:27:00.054 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 4 16 180 164 0.32029 0.351562 0.201693 0.369888 2026-02-22T22:27:01.054 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 5 16 222 206 0.321852 0.328125 0.402774 0.360411 2026-02-22T22:27:02.054 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 6 16 270 254 0.330706 0.375 0.401062 0.358654 2026-02-22T22:27:03.054 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 7 16 306 290 0.323638 0.28125 0.401982 0.365017 2026-02-22T22:27:04.054 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 8 16 348 332 0.324196 0.328125 0.401939 0.373492 2026-02-22T22:27:05.054 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 9 16 388 372 0.322894 0.3125 0.303047 0.378478 2026-02-22T22:27:06.054 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 10 16 431 415 0.324197 0.335938 0.10275 0.380209 2026-02-22T22:27:07.054 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 11 16 464 448 0.31816 0.257812 0.404549 0.386001 2026-02-22T22:27:08.054 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 12 16 510 494 0.321593 0.359375 0.399445 0.382294 2026-02-22T22:27:09.055 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 13 16 561 545 0.327502 0.398438 0.201879 0.378103 2026-02-22T22:27:10.055 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 14 16 606 590 0.329219 0.351562 0.501833 0.375523 2026-02-22T22:27:11.055 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 15 16 649 633 0.329665 0.335938 0.509832 0.375254 2026-02-22T22:27:12.055 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 16 16 687 671 0.327615 0.296875 0.306263 0.378821 2026-02-22T22:27:13.055 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 17 16 724 708 0.325346 0.289062 0.304968 0.377818 2026-02-22T22:27:14.055 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 18 16 768 752 0.326367 0.34375 0.205204 0.379967 2026-02-22T22:27:15.055 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 19 16 787 771 0.317002 0.148438 1.00237 0.383622 2026-02-22T22:27:16.055 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:27:16.051786+0000 min lat: 0.0010469 max lat: 1.29942 avg lat: 0.391956 2026-02-22T22:27:16.055 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:27:16.055 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 20 16 821 805 0.314432 0.265625 0.503216 0.391956 2026-02-22T22:27:17.055 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 21 16 864 848 0.315455 0.335938 0.301465 0.392496 2026-02-22T22:27:18.055 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 22 16 896 880 0.312479 0.25 1.00734 0.396098 2026-02-22T22:27:19.055 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 23 16 921 905 0.307385 0.195312 0.402568 0.402561 2026-02-22T22:27:20.055 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 24 16 964 948 0.308574 0.335938 0.30455 0.402374 2026-02-22T22:27:21.055 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 25 16 1000 984 0.30748 0.28125 0.303784 0.403989 2026-02-22T22:27:22.055 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 26 16 1045 1029 0.309175 0.351562 0.202 0.40151 2026-02-22T22:27:23.055 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 27 16 1090 1074 0.310744 0.351562 0.205625 0.400251 2026-02-22T22:27:24.055 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 28 16 1131 1115 0.311085 0.320312 0.105804 0.398394 2026-02-22T22:27:25.056 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 29 16 1180 1164 0.313557 0.382812 0.104307 0.395524 2026-02-22T22:27:26.055 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 30 16 1218 1202 0.313001 0.296875 0.400794 0.397098 2026-02-22T22:27:27.056 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 31 16 1253 1237 0.311724 0.273438 0.29954 0.396504 2026-02-22T22:27:28.056 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 32 16 1291 1275 0.311259 0.296875 0.202728 0.397966 2026-02-22T22:27:29.056 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 33 16 1325 1309 0.309876 0.265625 0.401272 0.398546 2026-02-22T22:27:30.056 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 34 16 1359 1343 0.308574 0.265625 0.5033 0.401106 2026-02-22T22:27:31.056 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 35 16 1398 1382 0.308462 0.304688 0.30175 0.402888 2026-02-22T22:27:32.056 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 36 16 1441 1425 0.309225 0.335938 0.404741 0.401244 2026-02-22T22:27:33.056 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 37 16 1486 1470 0.310369 0.351562 0.203727 0.400672 2026-02-22T22:27:34.056 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 38 16 1532 1516 0.311658 0.359375 0.503425 0.399219 2026-02-22T22:27:35.056 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 39 16 1580 1564 0.313281 0.375 0.207197 0.397338 2026-02-22T22:27:36.056 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:27:36.053026+0000 min lat: 0.0010469 max lat: 1.29942 avg lat: 0.396043 2026-02-22T22:27:36.057 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:27:36.057 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 40 16 1618 1602 0.31287 0.296875 0.404084 0.396043 2026-02-22T22:27:37.056 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 41 16 1661 1645 0.313433 0.335938 0.102506 0.397929 2026-02-22T22:27:38.057 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 42 16 1695 1679 0.312294 0.265625 0.30549 0.398086 2026-02-22T22:27:39.056 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 43 16 1734 1718 0.312116 0.304688 0.301955 0.399293 2026-02-22T22:27:40.057 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 44 16 1767 1751 0.310882 0.257812 0.504208 0.39836 2026-02-22T22:27:41.056 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 45 16 1820 1804 0.313174 0.414062 0.505108 0.398056 2026-02-22T22:27:42.057 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 46 16 1866 1850 0.314178 0.359375 0.305771 0.396127 2026-02-22T22:27:43.057 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 47 16 1908 1892 0.314474 0.328125 0.302028 0.395233 2026-02-22T22:27:44.057 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 48 16 1940 1924 0.313131 0.25 0.60383 0.396957 2026-02-22T22:27:45.057 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 49 16 1982 1966 0.313436 0.328125 0.302813 0.396111 2026-02-22T22:27:46.057 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 50 16 2039 2023 0.316073 0.445312 0.40181 0.393885 2026-02-22T22:27:47.057 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 51 16 2077 2061 0.315696 0.296875 0.403906 0.393895 2026-02-22T22:27:48.057 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 52 16 2115 2099 0.315334 0.296875 0.303538 0.393532 2026-02-22T22:27:49.057 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 53 16 2159 2143 0.31587 0.34375 0.301715 0.394252 2026-02-22T22:27:50.057 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 54 16 2194 2178 0.315084 0.273438 0.302503 0.395681 2026-02-22T22:27:51.057 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 55 16 2250 2234 0.317309 0.4375 0.203131 0.393092 2026-02-22T22:27:52.057 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 56 16 2290 2274 0.317223 0.3125 0.40683 0.392636 2026-02-22T22:27:53.057 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 57 16 2332 2316 0.317414 0.328125 0.473389 0.392413 2026-02-22T22:27:54.058 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 58 16 2373 2357 0.317463 0.320312 0.53405 0.391627 2026-02-22T22:27:55.058 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 59 16 2416 2400 0.317776 0.335938 0.371141 0.392312 2026-02-22T22:27:56.058 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:27:56.054345+0000 min lat: 0.0010469 max lat: 1.29942 avg lat: 0.390674 2026-02-22T22:27:56.058 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:27:56.058 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 60 16 2465 2449 0.31886 0.382812 0.402348 0.390674 2026-02-22T22:27:57.058 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 61 16 2502 2486 0.318371 0.289062 0.301664 0.391126 2026-02-22T22:27:58.058 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 62 16 2548 2532 0.319032 0.359375 0.404289 0.39019 2026-02-22T22:27:59.058 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 63 16 2591 2575 0.3193 0.335938 0.606221 0.390413 2026-02-22T22:28:00.058 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 64 16 2631 2615 0.319193 0.3125 0.403868 0.389802 2026-02-22T22:28:01.058 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 65 16 2680 2664 0.320171 0.382812 0.00236141 0.38961 2026-02-22T22:28:02.058 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 66 16 2715 2699 0.319463 0.273438 0.205058 0.390012 2026-02-22T22:28:03.058 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 67 16 2763 2747 0.320292 0.375 0.304452 0.388995 2026-02-22T22:28:04.058 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 68 16 2795 2779 0.319258 0.25 0.501265 0.390693 2026-02-22T22:28:05.058 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 69 16 2835 2819 0.319159 0.3125 0.605811 0.390156 2026-02-22T22:28:06.058 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 70 16 2871 2855 0.318618 0.28125 0.106777 0.39176 2026-02-22T22:28:07.059 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 71 16 2916 2900 0.319081 0.351562 0.201844 0.390846 2026-02-22T22:28:08.059 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 72 16 2966 2950 0.320075 0.390625 0.605385 0.389321 2026-02-22T22:28:09.059 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 73 16 2998 2982 0.319114 0.25 0.607425 0.389531 2026-02-22T22:28:10.059 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 74 16 3035 3019 0.318708 0.289062 0.50184 0.390361 2026-02-22T22:28:11.059 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 75 16 3077 3061 0.318833 0.328125 0.401845 0.390283 2026-02-22T22:28:12.059 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 76 16 3120 3104 0.319058 0.335938 0.302083 0.390582 2026-02-22T22:28:13.059 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 77 16 3164 3148 0.319379 0.34375 0.402897 0.39018 2026-02-22T22:28:14.059 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 78 16 3200 3184 0.318889 0.28125 0.603132 0.390284 2026-02-22T22:28:15.059 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 79 16 3243 3227 0.319105 0.335938 0.107552 0.390521 2026-02-22T22:28:16.059 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:28:16.055678+0000 min lat: 0.0010469 max lat: 1.29942 avg lat: 0.390105 2026-02-22T22:28:16.059 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:28:16.059 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 80 16 3288 3272 0.31951 0.351562 0.602362 0.390105 2026-02-22T22:28:17.059 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 81 16 3326 3310 0.319231 0.296875 0.603206 0.38988 2026-02-22T22:28:18.059 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 82 16 3368 3352 0.319339 0.328125 0.402723 0.390527 2026-02-22T22:28:19.059 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 83 16 3416 3400 0.320009 0.375 0.50829 0.389772 2026-02-22T22:28:20.059 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 84 16 3452 3436 0.319548 0.28125 0.302972 0.390301 2026-02-22T22:28:21.059 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 85 16 3498 3482 0.320016 0.359375 0.502903 0.389549 2026-02-22T22:28:22.060 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 86 16 3539 3523 0.320019 0.320312 0.101388 0.389562 2026-02-22T22:28:23.060 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 87 16 3581 3565 0.320112 0.328125 0.401167 0.38966 2026-02-22T22:28:24.060 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 88 16 3618 3602 0.319759 0.289062 0.400395 0.38937 2026-02-22T22:28:25.060 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 89 16 3652 3636 0.31915 0.265625 0.402288 0.39073 2026-02-22T22:28:26.060 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 90 16 3701 3685 0.319858 0.382812 0.202011 0.390183 2026-02-22T22:28:27.060 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Total time run: 90.3247 2026-02-22T22:28:27.060 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Total writes made: 3701 2026-02-22T22:28:27.060 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Write size: 8192 2026-02-22T22:28:27.061 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Object size: 65536 2026-02-22T22:28:27.061 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Bandwidth (MB/sec): 0.320112 2026-02-22T22:28:27.061 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Stddev Bandwidth: 0.04972 2026-02-22T22:28:27.061 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Max bandwidth (MB/sec): 0.445312 2026-02-22T22:28:27.061 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Min bandwidth (MB/sec): 0.148438 2026-02-22T22:28:27.061 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Average IOPS: 40 2026-02-22T22:28:27.061 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Stddev IOPS: 6.36416 2026-02-22T22:28:27.061 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Max IOPS: 57 2026-02-22T22:28:27.061 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Min IOPS: 19 2026-02-22T22:28:27.061 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Average Latency(s): 0.389861 2026-02-22T22:28:27.061 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Stddev Latency(s): 0.191245 2026-02-22T22:28:27.061 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Max latency(s): 1.29942 2026-02-22T22:28:27.062 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Min latency(s): 0.0010469 2026-02-22T22:28:27.162 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Cleaning up (deleting benchmark objects) 2026-02-22T22:28:34.257 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Removed 463 objects 2026-02-22T22:28:34.257 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Clean up completed and total clean up time :7.09504 2026-02-22T22:28:39.751 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_5 2026-02-22T22:28:39.752 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_5 unique_pool_5 --yes-i-really-really-mean-it 2026-02-22T22:28:40.046 INFO:teuthology.orchestra.run.trial061.stderr:pool 'unique_pool_5' removed 2026-02-22T22:28:40.058 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-22T22:28:40.058 INFO:tasks.radosbench:Beginning radosbench... 2026-02-22T22:28:40.058 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_6 2026-02-22T22:28:40.059 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_6 16 2026-02-22T22:28:41.050 INFO:teuthology.orchestra.run.trial061.stderr:pool 'unique_pool_6' created 2026-02-22T22:28:41.064 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_6 rados --yes-i-really-mean-it || true 2026-02-22T22:28:42.055 INFO:teuthology.orchestra.run.trial061.stderr:enabled application 'rados' on pool 'unique_pool_6' 2026-02-22T22:28:43.070 DEBUG:teuthology.orchestra.run.trial061:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_6 bench 90 write' 2026-02-22T22:28:43.072 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-22T22:28:43.072 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-22T22:28:43.096 INFO:tasks.radosbench.radosbench.0.trial061.stdout:hints = 1 2026-02-22T22:28:43.096 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-22T22:28:43.096 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Object prefix: benchmark_data_trial061_23015 2026-02-22T22:28:43.097 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:28:43.097 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 0 0 0 0 0 0 - 0 2026-02-22T22:28:44.096 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 1 16 47 31 0.242169 0.242188 0.30165 0.346683 2026-02-22T22:28:45.096 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 2 16 101 85 0.332007 0.421875 0.400197 0.318889 2026-02-22T22:28:46.096 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 3 16 135 119 0.309874 0.265625 0.302467 0.367086 2026-02-22T22:28:47.096 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 4 16 174 158 0.308572 0.304688 0.00206879 0.368938 2026-02-22T22:28:48.096 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 5 16 213 197 0.307791 0.304688 0.704143 0.389575 2026-02-22T22:28:49.096 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 6 16 255 239 0.311177 0.328125 0.402289 0.385578 2026-02-22T22:28:50.097 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 7 16 292 276 0.308015 0.289062 0.503396 0.389325 2026-02-22T22:28:51.097 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 8 16 341 325 0.317361 0.382812 0.213907 0.383075 2026-02-22T22:28:52.097 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 9 16 380 364 0.315951 0.304688 0.101672 0.385131 2026-02-22T22:28:53.097 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 10 16 420 404 0.315604 0.3125 0.200962 0.38532 2026-02-22T22:28:54.097 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 11 16 469 453 0.321711 0.382812 0.10189 0.378378 2026-02-22T22:28:55.097 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 12 16 516 500 0.325499 0.367188 0.404273 0.379205 2026-02-22T22:28:56.097 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 13 16 553 537 0.322695 0.289062 0.30356 0.380453 2026-02-22T22:28:57.097 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 14 16 593 577 0.321965 0.3125 0.40281 0.381439 2026-02-22T22:28:58.097 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 15 16 645 629 0.327582 0.40625 0.102058 0.375932 2026-02-22T22:28:59.097 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 16 16 695 679 0.331521 0.390625 0.342735 0.375133 2026-02-22T22:29:00.097 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 17 16 736 720 0.33086 0.320312 0.101428 0.37139 2026-02-22T22:29:01.097 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 18 16 782 766 0.332443 0.359375 0.60315 0.372594 2026-02-22T22:29:02.098 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 19 16 810 794 0.326458 0.21875 0.901763 0.375398 2026-02-22T22:29:03.097 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:29:03.093972+0000 min lat: 0.00115854 max lat: 0.906524 avg lat: 0.375684 2026-02-22T22:29:03.098 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:29:03.098 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 20 16 861 845 0.330056 0.398438 0.209708 0.375684 2026-02-22T22:29:04.097 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 21 16 896 880 0.327359 0.273438 0.605279 0.377226 2026-02-22T22:29:05.098 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 22 16 946 930 0.330234 0.390625 0.202517 0.374642 2026-02-22T22:29:06.097 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 23 16 960 944 0.320631 0.109375 0.498657 0.374264 2026-02-22T22:29:07.098 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 24 16 993 977 0.318013 0.257812 0.401446 0.389527 2026-02-22T22:29:08.098 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 25 16 1034 1018 0.318104 0.320312 0.500976 0.388175 2026-02-22T22:29:09.098 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 26 16 1079 1063 0.31939 0.351562 0.403846 0.38852 2026-02-22T22:29:10.098 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 27 16 1126 1110 0.321159 0.367188 0.301175 0.385701 2026-02-22T22:29:11.098 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 28 16 1173 1157 0.322802 0.367188 0.101432 0.381808 2026-02-22T22:29:12.098 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 29 16 1212 1196 0.322177 0.304688 0.202319 0.384435 2026-02-22T22:29:13.098 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 30 16 1257 1241 0.323155 0.351562 0.505349 0.383668 2026-02-22T22:29:14.098 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 31 16 1298 1282 0.323063 0.320312 0.301432 0.384573 2026-02-22T22:29:15.098 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 32 16 1345 1329 0.324441 0.367188 0.19986 0.381224 2026-02-22T22:29:16.098 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 33 16 1391 1375 0.325499 0.359375 0.303445 0.382302 2026-02-22T22:29:17.098 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 34 16 1426 1410 0.323967 0.273438 0.00158829 0.384011 2026-02-22T22:29:18.098 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 35 16 1467 1451 0.323862 0.320312 0.504106 0.383407 2026-02-22T22:29:19.099 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 36 16 1503 1487 0.322678 0.28125 0.50121 0.38328 2026-02-22T22:29:20.099 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 37 16 1549 1533 0.323669 0.359375 0.201748 0.383494 2026-02-22T22:29:21.099 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 38 16 1595 1579 0.324608 0.359375 0.305257 0.381706 2026-02-22T22:29:22.099 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 39 16 1636 1620 0.324498 0.320312 0.303361 0.382287 2026-02-22T22:29:23.099 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:29:23.095298+0000 min lat: 0.00115854 max lat: 1.64049 avg lat: 0.381452 2026-02-22T22:29:23.099 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:29:23.099 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 40 16 1685 1669 0.325955 0.382812 0.403837 0.381452 2026-02-22T22:29:24.099 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 41 16 1733 1717 0.32715 0.375 0.10553 0.380649 2026-02-22T22:29:25.099 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 42 16 1776 1760 0.327359 0.335938 0.402985 0.37993 2026-02-22T22:29:26.099 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 43 16 1814 1798 0.32665 0.296875 0.202099 0.380415 2026-02-22T22:29:27.099 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 44 16 1845 1829 0.32473 0.242188 0.607719 0.382833 2026-02-22T22:29:28.099 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 45 16 1891 1875 0.325499 0.359375 0.200514 0.382415 2026-02-22T22:29:29.099 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 46 16 1936 1920 0.326065 0.351562 0.503757 0.381899 2026-02-22T22:29:30.099 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 47 16 1987 1971 0.327605 0.398438 0.302877 0.381157 2026-02-22T22:29:31.099 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 48 16 2015 1999 0.325336 0.21875 0.502972 0.383012 2026-02-22T22:29:32.099 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 49 16 2051 2035 0.324436 0.28125 0.298601 0.383321 2026-02-22T22:29:33.100 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 50 16 2098 2082 0.325291 0.367188 0.202998 0.382251 2026-02-22T22:29:34.100 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 51 16 2145 2129 0.326112 0.367188 0.406092 0.381808 2026-02-22T22:29:35.100 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 52 16 2163 2147 0.322545 0.140625 1.10621 0.382317 2026-02-22T22:29:36.100 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 53 16 2208 2192 0.323092 0.351562 0.201233 0.385069 2026-02-22T22:29:37.100 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 54 16 2252 2236 0.323474 0.34375 0.601769 0.385139 2026-02-22T22:29:38.100 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 55 16 2296 2280 0.323842 0.34375 0.405067 0.385396 2026-02-22T22:29:39.100 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 56 16 2340 2324 0.324197 0.34375 0.302606 0.384346 2026-02-22T22:29:40.100 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 57 16 2374 2358 0.323169 0.265625 0.502216 0.38508 2026-02-22T22:29:41.100 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 58 16 2406 2390 0.321908 0.25 0.00273867 0.385948 2026-02-22T22:29:42.100 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 59 16 2451 2435 0.32241 0.351562 0.301475 0.385368 2026-02-22T22:29:43.100 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:29:43.096606+0000 min lat: 0.00115854 max lat: 1.64049 avg lat: 0.385013 2026-02-22T22:29:43.100 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:29:43.100 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 60 16 2497 2481 0.323025 0.359375 0.301917 0.385013 2026-02-22T22:29:44.100 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 61 16 2549 2533 0.324389 0.40625 0.405475 0.384542 2026-02-22T22:29:45.100 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 62 16 2586 2570 0.323819 0.289062 0.00136257 0.384299 2026-02-22T22:29:46.100 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 63 16 2625 2609 0.323515 0.304688 0.304174 0.384136 2026-02-22T22:29:47.101 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 64 16 2667 2651 0.323587 0.328125 0.101319 0.384061 2026-02-22T22:29:48.101 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 65 16 2704 2688 0.323056 0.289062 0.502924 0.385426 2026-02-22T22:29:49.100 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 66 16 2753 2737 0.323961 0.382812 0.203138 0.384749 2026-02-22T22:29:50.100 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 67 16 2794 2778 0.323906 0.320312 0.400462 0.384435 2026-02-22T22:29:51.101 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 68 16 2839 2823 0.324312 0.351562 0.30183 0.384228 2026-02-22T22:29:52.101 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 69 16 2874 2858 0.323575 0.273438 0.507059 0.384973 2026-02-22T22:29:53.101 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 70 16 2908 2892 0.322747 0.265625 0.599212 0.385318 2026-02-22T22:29:54.101 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 71 16 2944 2928 0.322162 0.28125 0.102368 0.386491 2026-02-22T22:29:55.101 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 72 16 2986 2970 0.322244 0.328125 0.203249 0.386971 2026-02-22T22:29:56.101 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 73 16 3029 3013 0.322432 0.335938 0.302455 0.38653 2026-02-22T22:29:57.101 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 74 16 3068 3052 0.322192 0.304688 0.50341 0.386899 2026-02-22T22:29:58.101 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 75 16 3123 3107 0.323624 0.429688 0.508279 0.3857 2026-02-22T22:29:59.101 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 76 16 3171 3155 0.3243 0.375 0.103252 0.385182 2026-02-22T22:30:00.101 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 77 16 3206 3190 0.323639 0.273438 0.503754 0.38503 2026-02-22T22:30:01.102 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 78 16 3240 3224 0.322895 0.265625 0.602751 0.385804 2026-02-22T22:30:02.101 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 79 16 3281 3265 0.322862 0.320312 0.30336 0.385943 2026-02-22T22:30:03.102 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:30:03.097919+0000 min lat: 0.00115854 max lat: 1.64049 avg lat: 0.383985 2026-02-22T22:30:03.102 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:30:03.102 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 80 16 3341 3325 0.324686 0.46875 0.302065 0.383985 2026-02-22T22:30:04.102 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 81 16 3369 3353 0.323378 0.21875 0.702013 0.385001 2026-02-22T22:30:05.101 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 82 16 3406 3390 0.322959 0.289062 0.602748 0.3852 2026-02-22T22:30:06.102 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 83 16 3453 3437 0.323491 0.367188 0.101846 0.384587 2026-02-22T22:30:07.102 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 84 16 3479 3463 0.322058 0.203125 0.706271 0.38603 2026-02-22T22:30:08.102 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 85 16 3512 3496 0.321302 0.257812 0.302076 0.387882 2026-02-22T22:30:09.102 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 86 16 3536 3520 0.319746 0.1875 0.705304 0.38859 2026-02-22T22:30:10.102 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 87 16 3572 3556 0.319304 0.28125 0.601402 0.390485 2026-02-22T22:30:11.102 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 88 16 3615 3599 0.319492 0.335938 0.404406 0.39036 2026-02-22T22:30:12.102 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 89 16 3652 3636 0.31915 0.289062 0.303813 0.390626 2026-02-22T22:30:13.102 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 90 16 3695 3679 0.319337 0.335938 0.301881 0.390605 2026-02-22T22:30:14.103 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Total time run: 90.3005 2026-02-22T22:30:14.103 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Total writes made: 3695 2026-02-22T22:30:14.103 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Write size: 8192 2026-02-22T22:30:14.103 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Object size: 65536 2026-02-22T22:30:14.104 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Bandwidth (MB/sec): 0.319679 2026-02-22T22:30:14.104 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Stddev Bandwidth: 0.0613351 2026-02-22T22:30:14.104 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Max bandwidth (MB/sec): 0.46875 2026-02-22T22:30:14.104 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Min bandwidth (MB/sec): 0.109375 2026-02-22T22:30:14.104 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Average IOPS: 40 2026-02-22T22:30:14.104 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Stddev IOPS: 7.8509 2026-02-22T22:30:14.104 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Max IOPS: 60 2026-02-22T22:30:14.105 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Min IOPS: 14 2026-02-22T22:30:14.105 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Average Latency(s): 0.390653 2026-02-22T22:30:14.105 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Stddev Latency(s): 0.192577 2026-02-22T22:30:14.105 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Max latency(s): 1.64049 2026-02-22T22:30:14.105 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Min latency(s): 0.00115854 2026-02-22T22:30:14.304 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Cleaning up (deleting benchmark objects) 2026-02-22T22:30:21.443 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Removed 462 objects 2026-02-22T22:30:21.444 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Clean up completed and total clean up time :7.13905 2026-02-22T22:30:26.794 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_6 2026-02-22T22:30:26.794 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_6 unique_pool_6 --yes-i-really-really-mean-it 2026-02-22T22:30:27.001 INFO:teuthology.orchestra.run.trial061.stderr:pool 'unique_pool_6' removed 2026-02-22T22:30:27.018 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-22T22:30:27.019 INFO:tasks.radosbench:Beginning radosbench... 2026-02-22T22:30:27.019 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_7 2026-02-22T22:30:27.019 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_7 16 2026-02-22T22:30:28.036 INFO:teuthology.orchestra.run.trial061.stderr:pool 'unique_pool_7' created 2026-02-22T22:30:28.050 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_7 rados --yes-i-really-mean-it || true 2026-02-22T22:30:29.036 INFO:teuthology.orchestra.run.trial061.stderr:enabled application 'rados' on pool 'unique_pool_7' 2026-02-22T22:30:30.054 DEBUG:teuthology.orchestra.run.trial061:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_7 bench 90 write' 2026-02-22T22:30:30.056 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-22T22:30:30.057 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-22T22:30:30.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout:hints = 1 2026-02-22T22:30:30.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-22T22:30:30.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Object prefix: benchmark_data_trial061_23122 2026-02-22T22:30:30.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:30:30.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 0 0 0 0 0 0 - 0 2026-02-22T22:30:31.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 1 16 52 36 0.281227 0.28125 0.299831 0.292109 2026-02-22T22:30:32.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 2 16 96 80 0.312477 0.34375 0.203584 0.36703 2026-02-22T22:30:33.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 3 16 125 109 0.283834 0.226562 0.203964 0.390004 2026-02-22T22:30:34.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 4 16 180 164 0.32029 0.429688 0.20204 0.373207 2026-02-22T22:30:35.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 5 16 218 202 0.315603 0.296875 0.403354 0.379518 2026-02-22T22:30:36.081 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 6 16 258 242 0.315082 0.3125 0.302402 0.372184 2026-02-22T22:30:37.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 7 16 291 275 0.306898 0.257812 0.300753 0.380533 2026-02-22T22:30:38.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 8 16 329 313 0.305643 0.296875 0.203856 0.401448 2026-02-22T22:30:39.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 9 16 366 350 0.303798 0.289062 0.40336 0.40113 2026-02-22T22:30:40.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 10 16 409 393 0.30701 0.335938 0.202929 0.398767 2026-02-22T22:30:41.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 11 16 449 433 0.307507 0.3125 0.402367 0.401306 2026-02-22T22:30:42.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 12 16 486 470 0.305969 0.289062 0.303473 0.403969 2026-02-22T22:30:43.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 13 16 528 512 0.307671 0.328125 0.402891 0.399512 2026-02-22T22:30:44.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 14 16 557 541 0.301877 0.226562 0.101618 0.408961 2026-02-22T22:30:45.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 15 16 596 580 0.302063 0.304688 0.303327 0.405157 2026-02-22T22:30:46.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 16 16 642 626 0.305643 0.359375 0.00122658 0.404907 2026-02-22T22:30:47.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 17 16 686 670 0.307883 0.34375 0.302597 0.400467 2026-02-22T22:30:48.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 18 16 732 716 0.310743 0.359375 0.403459 0.397965 2026-02-22T22:30:49.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 19 16 757 741 0.304667 0.195312 0.601378 0.403669 2026-02-22T22:30:50.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:30:50.078719+0000 min lat: 0.00103713 max lat: 1.10515 avg lat: 0.407894 2026-02-22T22:30:50.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:30:50.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 20 16 794 778 0.303886 0.289062 0.203959 0.407894 2026-02-22T22:30:51.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 21 16 834 818 0.304295 0.3125 0.402708 0.406423 2026-02-22T22:30:52.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 22 16 876 860 0.305377 0.328125 0.402154 0.40558 2026-02-22T22:30:53.082 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 23 16 922 906 0.307724 0.359375 0.301142 0.402032 2026-02-22T22:30:54.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 24 16 961 945 0.307596 0.304688 0.602775 0.400568 2026-02-22T22:30:55.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 25 16 1000 984 0.307479 0.304688 0.302958 0.402174 2026-02-22T22:30:56.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 26 16 1042 1026 0.308272 0.328125 0.304546 0.402218 2026-02-22T22:30:57.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 27 16 1076 1060 0.306692 0.265625 0.201997 0.402996 2026-02-22T22:30:58.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 28 16 1116 1100 0.306899 0.3125 0.00131473 0.402625 2026-02-22T22:30:59.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 29 16 1162 1146 0.308708 0.359375 0.00162765 0.401228 2026-02-22T22:31:00.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 30 16 1208 1192 0.310396 0.359375 0.101878 0.401144 2026-02-22T22:31:01.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 31 16 1243 1227 0.309203 0.273438 0.705399 0.401218 2026-02-22T22:31:02.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 32 16 1280 1264 0.308573 0.289062 0.300485 0.402827 2026-02-22T22:31:03.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 33 16 1326 1310 0.310112 0.359375 0.405493 0.401508 2026-02-22T22:31:04.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 34 16 1370 1354 0.3111 0.34375 0.407166 0.39939 2026-02-22T22:31:05.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 35 16 1410 1394 0.31114 0.3125 0.30117 0.399508 2026-02-22T22:31:06.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 36 16 1447 1431 0.310526 0.289062 0.205531 0.399531 2026-02-22T22:31:07.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 37 16 1483 1467 0.309734 0.28125 0.401035 0.400963 2026-02-22T22:31:08.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 38 16 1518 1502 0.308779 0.273438 0.602657 0.402071 2026-02-22T22:31:09.083 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 39 16 1548 1532 0.30687 0.234375 0.502746 0.403739 2026-02-22T22:31:10.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:31:10.080051+0000 min lat: 0.00103713 max lat: 1.10515 avg lat: 0.405929 2026-02-22T22:31:10.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:31:10.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 40 16 1585 1569 0.306425 0.289062 0.503806 0.405929 2026-02-22T22:31:11.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 41 16 1629 1613 0.307334 0.34375 0.308857 0.404545 2026-02-22T22:31:12.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 42 16 1672 1656 0.308015 0.335938 0.403273 0.403252 2026-02-22T22:31:13.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 43 16 1722 1706 0.309936 0.390625 0.0012297 0.402016 2026-02-22T22:31:14.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 44 16 1772 1756 0.311769 0.390625 0.507638 0.399065 2026-02-22T22:31:15.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 45 16 1810 1794 0.311437 0.296875 0.501558 0.399276 2026-02-22T22:31:16.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 46 16 1852 1836 0.3118 0.328125 0.41055 0.399497 2026-02-22T22:31:17.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 47 16 1889 1873 0.311315 0.289062 0.302753 0.399957 2026-02-22T22:31:18.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 48 16 1926 1910 0.310851 0.289062 0.100638 0.39974 2026-02-22T22:31:19.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 49 16 1958 1942 0.309609 0.25 0.803802 0.401423 2026-02-22T22:31:20.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 50 16 2009 1993 0.311385 0.398438 0.503808 0.400052 2026-02-22T22:31:21.084 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 51 16 2055 2039 0.312326 0.359375 0.221534 0.398745 2026-02-22T22:31:22.085 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 52 16 2085 2069 0.310826 0.234375 0.405549 0.399742 2026-02-22T22:31:23.085 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 53 16 2111 2095 0.308794 0.203125 0.101548 0.400951 2026-02-22T22:31:24.085 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 54 16 2146 2130 0.308139 0.273438 0.40094 0.403142 2026-02-22T22:31:25.085 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 55 16 2191 2175 0.308928 0.351562 0.105377 0.402596 2026-02-22T22:31:26.085 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 56 16 2225 2209 0.308155 0.265625 0.502637 0.403509 2026-02-22T22:31:27.085 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 57 16 2250 2234 0.306175 0.195312 0.604516 0.404712 2026-02-22T22:31:28.085 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 58 16 2302 2286 0.3079 0.40625 0.203741 0.404577 2026-02-22T22:31:29.085 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 59 16 2340 2324 0.307712 0.296875 0.30207 0.404683 2026-02-22T22:31:30.085 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:31:30.081378+0000 min lat: 0.00103713 max lat: 1.10515 avg lat: 0.403412 2026-02-22T22:31:30.085 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:31:30.085 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 60 16 2381 2365 0.307922 0.320312 0.602121 0.403412 2026-02-22T22:31:31.085 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 61 16 2420 2404 0.307869 0.304688 0.402119 0.403982 2026-02-22T22:31:32.086 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 62 16 2451 2435 0.306809 0.242188 0.501114 0.405731 2026-02-22T22:31:33.085 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 63 16 2490 2474 0.306775 0.304688 0.705133 0.406293 2026-02-22T22:31:34.086 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 64 16 2529 2513 0.306742 0.304688 0.202669 0.406456 2026-02-22T22:31:35.086 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 65 16 2578 2562 0.307912 0.382812 0.302937 0.405341 2026-02-22T22:31:36.086 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 66 16 2616 2600 0.307745 0.296875 0.308106 0.405305 2026-02-22T22:31:37.086 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 67 16 2651 2635 0.307232 0.273438 0.301977 0.405706 2026-02-22T22:31:38.086 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 68 16 2680 2664 0.306046 0.226562 0.302561 0.407371 2026-02-22T22:31:39.086 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 69 16 2722 2706 0.306365 0.328125 0.101554 0.406224 2026-02-22T22:31:40.086 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 70 16 2768 2752 0.307122 0.359375 0.20239 0.40524 2026-02-22T22:31:41.086 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 71 16 2794 2778 0.305657 0.203125 0.701926 0.406722 2026-02-22T22:31:42.086 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 72 16 2835 2819 0.305861 0.320312 0.301159 0.407443 2026-02-22T22:31:43.086 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 73 16 2881 2865 0.306593 0.359375 0.396693 0.406612 2026-02-22T22:31:44.086 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 74 16 2923 2907 0.306884 0.328125 0.401542 0.406282 2026-02-22T22:31:45.086 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 75 16 2958 2942 0.306438 0.273438 0.202164 0.406735 2026-02-22T22:31:46.086 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 76 16 2996 2980 0.306312 0.296875 0.398339 0.40672 2026-02-22T22:31:47.086 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 77 16 3036 3020 0.306392 0.3125 0.600792 0.406862 2026-02-22T22:31:48.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 78 16 3082 3066 0.307071 0.359375 0.506791 0.405987 2026-02-22T22:31:49.086 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 79 16 3140 3124 0.308919 0.453125 0.301772 0.403506 2026-02-22T22:31:50.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout:2026-02-22T22:31:50.082712+0000 min lat: 0.00103713 max lat: 1.10515 avg lat: 0.404043 2026-02-22T22:31:50.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-22T22:31:50.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 80 16 3176 3160 0.308573 0.28125 0.302652 0.404043 2026-02-22T22:31:51.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 81 16 3214 3198 0.308428 0.296875 0.604356 0.404094 2026-02-22T22:31:52.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 82 16 3258 3242 0.308859 0.34375 0.605067 0.403925 2026-02-22T22:31:53.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 83 16 3306 3290 0.309655 0.375 0.202736 0.403009 2026-02-22T22:31:54.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 84 16 3348 3332 0.309875 0.328125 0.203434 0.402222 2026-02-22T22:31:55.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 85 16 3400 3384 0.311009 0.40625 0.00547186 0.400963 2026-02-22T22:31:56.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 86 16 3448 3432 0.311752 0.375 0.301564 0.400186 2026-02-22T22:31:57.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 87 16 3480 3464 0.311042 0.25 0.102419 0.400556 2026-02-22T22:31:58.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 88 16 3521 3505 0.311147 0.320312 0.305621 0.401037 2026-02-22T22:31:59.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 89 16 3555 3539 0.310636 0.265625 0.401918 0.401478 2026-02-22T22:32:00.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout: 90 16 3591 3575 0.310309 0.28125 0.401457 0.402172 2026-02-22T22:32:01.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Total time run: 90.4585 2026-02-22T22:32:01.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Total writes made: 3591 2026-02-22T22:32:01.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Write size: 8192 2026-02-22T22:32:01.087 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Object size: 65536 2026-02-22T22:32:01.088 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Bandwidth (MB/sec): 0.310139 2026-02-22T22:32:01.088 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Stddev Bandwidth: 0.0519812 2026-02-22T22:32:01.088 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Max bandwidth (MB/sec): 0.453125 2026-02-22T22:32:01.088 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Min bandwidth (MB/sec): 0.195312 2026-02-22T22:32:01.088 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Average IOPS: 39 2026-02-22T22:32:01.088 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Stddev IOPS: 6.65359 2026-02-22T22:32:01.088 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Max IOPS: 58 2026-02-22T22:32:01.088 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Min IOPS: 25 2026-02-22T22:32:01.088 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Average Latency(s): 0.402257 2026-02-22T22:32:01.088 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Stddev Latency(s): 0.181764 2026-02-22T22:32:01.088 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Max latency(s): 1.10515 2026-02-22T22:32:01.088 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Min latency(s): 0.00103713 2026-02-22T22:32:01.490 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Cleaning up (deleting benchmark objects) 2026-02-22T22:32:08.332 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Removed 449 objects 2026-02-22T22:32:08.333 INFO:tasks.radosbench.radosbench.0.trial061.stdout:Clean up completed and total clean up time :6.84224 2026-02-22T22:32:13.781 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_7 2026-02-22T22:32:13.781 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_7 unique_pool_7 --yes-i-really-really-mean-it 2026-02-22T22:32:14.064 INFO:teuthology.orchestra.run.trial061.stderr:pool 'unique_pool_7' removed 2026-02-22T22:32:14.078 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-22T22:32:14.091 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-22T22:32:14.091 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T22:32:14.238 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:32:14.239 INFO:teuthology.orchestra.run.trial061.stderr:dumped all 2026-02-22T22:32:14.249 INFO:teuthology.orchestra.run.trial061.stdout:{"pg_ready":true,"pg_map":{"version":488,"stamp":"2026-02-22T22:32:14.063001+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":474276,"kb_used_data":7396,"kb_used_omap":12,"kb_used_meta":466739,"kb_avail":754500444,"statfs":{"total":773094113280,"available":772608454656,"internally_reserved":0,"allocated":7573504,"data_stored":4135793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":477941304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,9,0,0,11,6,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-29065216,"num_objects":-444,"num_object_clones":0,"num_object_copies":-1332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-444,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3548,"num_write_kb":-28384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.070974"},"pg_stats":[{"pgid":"1.0","version":"23'112","reported_seq":244,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.141583+0000","last_change":"2026-02-22T22:17:52.234714+0000","last_active":"2026-02-22T22:30:30.141583+0000","last_peered":"2026-02-22T22:30:30.141583+0000","last_clean":"2026-02-22T22:30:30.141583+0000","last_became_active":"2026-02-22T22:17:52.233814+0000","last_became_peered":"2026-02-22T22:17:52.233814+0000","last_unstale":"2026-02-22T22:30:30.141583+0000","last_undegraded":"2026-02-22T22:30:30.141583+0000","last_fullsized":"2026-02-22T22:30:30.141583+0000","mapping_epoch":15,"log_start":"23'109","ondisk_log_start":"23'109","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:50.983542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:50.983542+0000","last_clean_scrub_stamp":"2026-02-22T22:17:50.983542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":109,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:48:32.581514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,2],"acting":[1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":94,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.083184+0000","last_change":"2026-02-22T22:18:05.904451+0000","last_active":"2026-02-22T22:30:30.083184+0000","last_peered":"2026-02-22T22:30:30.083184+0000","last_clean":"2026-02-22T22:30:30.083184+0000","last_became_active":"2026-02-22T22:18:05.904243+0000","last_became_peered":"2026-02-22T22:18:05.904243+0000","last_unstale":"2026-02-22T22:30:30.083184+0000","last_undegraded":"2026-02-22T22:30:30.083184+0000","last_fullsized":"2026-02-22T22:30:30.083184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:51:37.892449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3],"acting":[4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.245591+0000","last_change":"2026-02-22T22:18:06.003569+0000","last_active":"2026-02-22T22:30:30.245591+0000","last_peered":"2026-02-22T22:30:30.245591+0000","last_clean":"2026-02-22T22:30:30.245591+0000","last_became_active":"2026-02-22T22:18:06.003368+0000","last_became_peered":"2026-02-22T22:18:06.003368+0000","last_unstale":"2026-02-22T22:30:30.245591+0000","last_undegraded":"2026-02-22T22:30:30.245591+0000","last_fullsized":"2026-02-22T22:30:30.245591+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:32:51.942219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":104,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.111604+0000","last_change":"2026-02-22T22:17:59.246693+0000","last_active":"2026-02-22T22:30:30.111604+0000","last_peered":"2026-02-22T22:30:30.111604+0000","last_clean":"2026-02-22T22:30:30.111604+0000","last_became_active":"2026-02-22T22:17:57.217004+0000","last_became_peered":"2026-02-22T22:17:57.217004+0000","last_unstale":"2026-02-22T22:30:30.111604+0000","last_undegraded":"2026-02-22T22:30:30.111604+0000","last_fullsized":"2026-02-22T22:30:30.111604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:16:26.325314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10045264499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":105,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.080022+0000","last_change":"2026-02-22T22:17:59.119704+0000","last_active":"2026-02-22T22:30:30.080022+0000","last_peered":"2026-02-22T22:30:30.080022+0000","last_clean":"2026-02-22T22:30:30.080022+0000","last_became_active":"2026-02-22T22:17:57.214164+0000","last_became_peered":"2026-02-22T22:17:57.214164+0000","last_unstale":"2026-02-22T22:30:30.080022+0000","last_undegraded":"2026-02-22T22:30:30.080022+0000","last_fullsized":"2026-02-22T22:30:30.080022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:37:18.081861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011410280000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.045592+0000","last_change":"2026-02-22T22:17:59.060445+0000","last_active":"2026-02-22T22:30:30.045592+0000","last_peered":"2026-02-22T22:30:30.045592+0000","last_clean":"2026-02-22T22:30:30.045592+0000","last_became_active":"2026-02-22T22:17:57.190205+0000","last_became_peered":"2026-02-22T22:17:57.190205+0000","last_unstale":"2026-02-22T22:30:30.045592+0000","last_undegraded":"2026-02-22T22:30:30.045592+0000","last_fullsized":"2026-02-22T22:30:30.045592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:45:07.425114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000249304,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.080173+0000","last_change":"2026-02-22T22:17:59.219262+0000","last_active":"2026-02-22T22:30:30.080173+0000","last_peered":"2026-02-22T22:30:30.080173+0000","last_clean":"2026-02-22T22:30:30.080173+0000","last_became_active":"2026-02-22T22:17:57.116722+0000","last_became_peered":"2026-02-22T22:17:57.116722+0000","last_unstale":"2026-02-22T22:30:30.080173+0000","last_undegraded":"2026-02-22T22:30:30.080173+0000","last_fullsized":"2026-02-22T22:30:30.080173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:09:46.687325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10066288900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6],"acting":[3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":103,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.083099+0000","last_change":"2026-02-22T22:17:59.019611+0000","last_active":"2026-02-22T22:30:30.083099+0000","last_peered":"2026-02-22T22:30:30.083099+0000","last_clean":"2026-02-22T22:30:30.083099+0000","last_became_active":"2026-02-22T22:17:57.369042+0000","last_became_peered":"2026-02-22T22:17:57.369042+0000","last_unstale":"2026-02-22T22:30:30.083099+0000","last_undegraded":"2026-02-22T22:30:30.083099+0000","last_fullsized":"2026-02-22T22:30:30.083099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:27:03.006376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033978200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":103,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.080227+0000","last_change":"2026-02-22T22:17:59.319241+0000","last_active":"2026-02-22T22:30:30.080227+0000","last_peered":"2026-02-22T22:30:30.080227+0000","last_clean":"2026-02-22T22:30:30.080227+0000","last_became_active":"2026-02-22T22:17:57.368465+0000","last_became_peered":"2026-02-22T22:17:57.368465+0000","last_unstale":"2026-02-22T22:30:30.080227+0000","last_undegraded":"2026-02-22T22:30:30.080227+0000","last_fullsized":"2026-02-22T22:30:30.080227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:25:53.847732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100604244,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542318,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36012,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35262,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":749568,"data_stored":318638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36108743},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542319,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72104,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299736,"statfs":{"total":96636764160,"available":96562929664,"internally_reserved":0,"allocated":745472,"data_stored":318619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,4,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542317,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67948,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94303892,"statfs":{"total":96636764160,"available":96567185408,"internally_reserved":0,"allocated":749568,"data_stored":318638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":68811208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,5,0,0,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542319,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58736,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":57470,"kb_avail":94313104,"statfs":{"total":96636764160,"available":96576618496,"internally_reserved":0,"allocated":1277952,"data_stored":847547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58849734},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542318,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54580,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":94317260,"statfs":{"total":96636764160,"available":96580874240,"internally_reserved":0,"allocated":1282048,"data_stored":847566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542318,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58216,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":57470,"kb_avail":94313624,"statfs":{"total":96636764160,"available":96577150976,"internally_reserved":0,"allocated":745472,"data_stored":318619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58849734},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,4,0,0,2,2,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542318,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68464,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94303376,"statfs":{"total":96636764160,"available":96566657024,"internally_reserved":0,"allocated":1277952,"data_stored":847547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,2,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575022,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58216,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":57470,"kb_avail":94313624,"statfs":{"total":96636764160,"available":96577150976,"internally_reserved":0,"allocated":745472,"data_stored":318619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58849739},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T22:32:14.251 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T22:32:14.395 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:32:14.395 INFO:teuthology.orchestra.run.trial061.stderr:dumped all 2026-02-22T22:32:14.405 INFO:teuthology.orchestra.run.trial061.stdout:{"pg_ready":true,"pg_map":{"version":488,"stamp":"2026-02-22T22:32:14.063001+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":474276,"kb_used_data":7396,"kb_used_omap":12,"kb_used_meta":466739,"kb_avail":754500444,"statfs":{"total":773094113280,"available":772608454656,"internally_reserved":0,"allocated":7573504,"data_stored":4135793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":477941304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,9,0,0,11,6,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-29065216,"num_objects":-444,"num_object_clones":0,"num_object_copies":-1332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-444,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3548,"num_write_kb":-28384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.070974"},"pg_stats":[{"pgid":"1.0","version":"23'112","reported_seq":244,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.141583+0000","last_change":"2026-02-22T22:17:52.234714+0000","last_active":"2026-02-22T22:30:30.141583+0000","last_peered":"2026-02-22T22:30:30.141583+0000","last_clean":"2026-02-22T22:30:30.141583+0000","last_became_active":"2026-02-22T22:17:52.233814+0000","last_became_peered":"2026-02-22T22:17:52.233814+0000","last_unstale":"2026-02-22T22:30:30.141583+0000","last_undegraded":"2026-02-22T22:30:30.141583+0000","last_fullsized":"2026-02-22T22:30:30.141583+0000","mapping_epoch":15,"log_start":"23'109","ondisk_log_start":"23'109","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:50.983542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:50.983542+0000","last_clean_scrub_stamp":"2026-02-22T22:17:50.983542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":109,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:48:32.581514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,2],"acting":[1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":94,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.083184+0000","last_change":"2026-02-22T22:18:05.904451+0000","last_active":"2026-02-22T22:30:30.083184+0000","last_peered":"2026-02-22T22:30:30.083184+0000","last_clean":"2026-02-22T22:30:30.083184+0000","last_became_active":"2026-02-22T22:18:05.904243+0000","last_became_peered":"2026-02-22T22:18:05.904243+0000","last_unstale":"2026-02-22T22:30:30.083184+0000","last_undegraded":"2026-02-22T22:30:30.083184+0000","last_fullsized":"2026-02-22T22:30:30.083184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:51:37.892449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3],"acting":[4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.245591+0000","last_change":"2026-02-22T22:18:06.003569+0000","last_active":"2026-02-22T22:30:30.245591+0000","last_peered":"2026-02-22T22:30:30.245591+0000","last_clean":"2026-02-22T22:30:30.245591+0000","last_became_active":"2026-02-22T22:18:06.003368+0000","last_became_peered":"2026-02-22T22:18:06.003368+0000","last_unstale":"2026-02-22T22:30:30.245591+0000","last_undegraded":"2026-02-22T22:30:30.245591+0000","last_fullsized":"2026-02-22T22:30:30.245591+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:32:51.942219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":104,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.111604+0000","last_change":"2026-02-22T22:17:59.246693+0000","last_active":"2026-02-22T22:30:30.111604+0000","last_peered":"2026-02-22T22:30:30.111604+0000","last_clean":"2026-02-22T22:30:30.111604+0000","last_became_active":"2026-02-22T22:17:57.217004+0000","last_became_peered":"2026-02-22T22:17:57.217004+0000","last_unstale":"2026-02-22T22:30:30.111604+0000","last_undegraded":"2026-02-22T22:30:30.111604+0000","last_fullsized":"2026-02-22T22:30:30.111604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:16:26.325314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10045264499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":105,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.080022+0000","last_change":"2026-02-22T22:17:59.119704+0000","last_active":"2026-02-22T22:30:30.080022+0000","last_peered":"2026-02-22T22:30:30.080022+0000","last_clean":"2026-02-22T22:30:30.080022+0000","last_became_active":"2026-02-22T22:17:57.214164+0000","last_became_peered":"2026-02-22T22:17:57.214164+0000","last_unstale":"2026-02-22T22:30:30.080022+0000","last_undegraded":"2026-02-22T22:30:30.080022+0000","last_fullsized":"2026-02-22T22:30:30.080022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:37:18.081861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011410280000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.045592+0000","last_change":"2026-02-22T22:17:59.060445+0000","last_active":"2026-02-22T22:30:30.045592+0000","last_peered":"2026-02-22T22:30:30.045592+0000","last_clean":"2026-02-22T22:30:30.045592+0000","last_became_active":"2026-02-22T22:17:57.190205+0000","last_became_peered":"2026-02-22T22:17:57.190205+0000","last_unstale":"2026-02-22T22:30:30.045592+0000","last_undegraded":"2026-02-22T22:30:30.045592+0000","last_fullsized":"2026-02-22T22:30:30.045592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:45:07.425114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000249304,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.080173+0000","last_change":"2026-02-22T22:17:59.219262+0000","last_active":"2026-02-22T22:30:30.080173+0000","last_peered":"2026-02-22T22:30:30.080173+0000","last_clean":"2026-02-22T22:30:30.080173+0000","last_became_active":"2026-02-22T22:17:57.116722+0000","last_became_peered":"2026-02-22T22:17:57.116722+0000","last_unstale":"2026-02-22T22:30:30.080173+0000","last_undegraded":"2026-02-22T22:30:30.080173+0000","last_fullsized":"2026-02-22T22:30:30.080173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:09:46.687325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10066288900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6],"acting":[3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":103,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.083099+0000","last_change":"2026-02-22T22:17:59.019611+0000","last_active":"2026-02-22T22:30:30.083099+0000","last_peered":"2026-02-22T22:30:30.083099+0000","last_clean":"2026-02-22T22:30:30.083099+0000","last_became_active":"2026-02-22T22:17:57.369042+0000","last_became_peered":"2026-02-22T22:17:57.369042+0000","last_unstale":"2026-02-22T22:30:30.083099+0000","last_undegraded":"2026-02-22T22:30:30.083099+0000","last_fullsized":"2026-02-22T22:30:30.083099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:27:03.006376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033978200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":103,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.080227+0000","last_change":"2026-02-22T22:17:59.319241+0000","last_active":"2026-02-22T22:30:30.080227+0000","last_peered":"2026-02-22T22:30:30.080227+0000","last_clean":"2026-02-22T22:30:30.080227+0000","last_became_active":"2026-02-22T22:17:57.368465+0000","last_became_peered":"2026-02-22T22:17:57.368465+0000","last_unstale":"2026-02-22T22:30:30.080227+0000","last_undegraded":"2026-02-22T22:30:30.080227+0000","last_fullsized":"2026-02-22T22:30:30.080227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:25:53.847732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100604244,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542318,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36012,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35262,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":749568,"data_stored":318638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36108743},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542319,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72104,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299736,"statfs":{"total":96636764160,"available":96562929664,"internally_reserved":0,"allocated":745472,"data_stored":318619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,4,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542317,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67948,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94303892,"statfs":{"total":96636764160,"available":96567185408,"internally_reserved":0,"allocated":749568,"data_stored":318638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":68811208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,5,0,0,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542319,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58736,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":57470,"kb_avail":94313104,"statfs":{"total":96636764160,"available":96576618496,"internally_reserved":0,"allocated":1277952,"data_stored":847547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58849734},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542318,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54580,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":94317260,"statfs":{"total":96636764160,"available":96580874240,"internally_reserved":0,"allocated":1282048,"data_stored":847566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542318,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58216,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":57470,"kb_avail":94313624,"statfs":{"total":96636764160,"available":96577150976,"internally_reserved":0,"allocated":745472,"data_stored":318619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58849734},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,4,0,0,2,2,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542318,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68464,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94303376,"statfs":{"total":96636764160,"available":96566657024,"internally_reserved":0,"allocated":1277952,"data_stored":847547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,2,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575022,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58216,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":57470,"kb_avail":94313624,"statfs":{"total":96636764160,"available":96577150976,"internally_reserved":0,"allocated":745472,"data_stored":318619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58849739},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T22:32:14.407 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-22T22:32:14.407 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T22:32:14.552 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:32:14.552 INFO:teuthology.orchestra.run.trial061.stderr:dumped all 2026-02-22T22:32:14.562 INFO:teuthology.orchestra.run.trial061.stdout:{"pg_ready":true,"pg_map":{"version":488,"stamp":"2026-02-22T22:32:14.063001+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":474276,"kb_used_data":7396,"kb_used_omap":12,"kb_used_meta":466739,"kb_avail":754500444,"statfs":{"total":773094113280,"available":772608454656,"internally_reserved":0,"allocated":7573504,"data_stored":4135793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":477941304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,9,0,0,11,6,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-29065216,"num_objects":-444,"num_object_clones":0,"num_object_copies":-1332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-444,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3548,"num_write_kb":-28384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.070974"},"pg_stats":[{"pgid":"1.0","version":"23'112","reported_seq":244,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.141583+0000","last_change":"2026-02-22T22:17:52.234714+0000","last_active":"2026-02-22T22:30:30.141583+0000","last_peered":"2026-02-22T22:30:30.141583+0000","last_clean":"2026-02-22T22:30:30.141583+0000","last_became_active":"2026-02-22T22:17:52.233814+0000","last_became_peered":"2026-02-22T22:17:52.233814+0000","last_unstale":"2026-02-22T22:30:30.141583+0000","last_undegraded":"2026-02-22T22:30:30.141583+0000","last_fullsized":"2026-02-22T22:30:30.141583+0000","mapping_epoch":15,"log_start":"23'109","ondisk_log_start":"23'109","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:50.983542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:50.983542+0000","last_clean_scrub_stamp":"2026-02-22T22:17:50.983542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":109,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:48:32.581514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,2],"acting":[1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":94,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.083184+0000","last_change":"2026-02-22T22:18:05.904451+0000","last_active":"2026-02-22T22:30:30.083184+0000","last_peered":"2026-02-22T22:30:30.083184+0000","last_clean":"2026-02-22T22:30:30.083184+0000","last_became_active":"2026-02-22T22:18:05.904243+0000","last_became_peered":"2026-02-22T22:18:05.904243+0000","last_unstale":"2026-02-22T22:30:30.083184+0000","last_undegraded":"2026-02-22T22:30:30.083184+0000","last_fullsized":"2026-02-22T22:30:30.083184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:51:37.892449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3],"acting":[4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.245591+0000","last_change":"2026-02-22T22:18:06.003569+0000","last_active":"2026-02-22T22:30:30.245591+0000","last_peered":"2026-02-22T22:30:30.245591+0000","last_clean":"2026-02-22T22:30:30.245591+0000","last_became_active":"2026-02-22T22:18:06.003368+0000","last_became_peered":"2026-02-22T22:18:06.003368+0000","last_unstale":"2026-02-22T22:30:30.245591+0000","last_undegraded":"2026-02-22T22:30:30.245591+0000","last_fullsized":"2026-02-22T22:30:30.245591+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:32:51.942219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":104,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.111604+0000","last_change":"2026-02-22T22:17:59.246693+0000","last_active":"2026-02-22T22:30:30.111604+0000","last_peered":"2026-02-22T22:30:30.111604+0000","last_clean":"2026-02-22T22:30:30.111604+0000","last_became_active":"2026-02-22T22:17:57.217004+0000","last_became_peered":"2026-02-22T22:17:57.217004+0000","last_unstale":"2026-02-22T22:30:30.111604+0000","last_undegraded":"2026-02-22T22:30:30.111604+0000","last_fullsized":"2026-02-22T22:30:30.111604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:16:26.325314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10045264499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":105,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.080022+0000","last_change":"2026-02-22T22:17:59.119704+0000","last_active":"2026-02-22T22:30:30.080022+0000","last_peered":"2026-02-22T22:30:30.080022+0000","last_clean":"2026-02-22T22:30:30.080022+0000","last_became_active":"2026-02-22T22:17:57.214164+0000","last_became_peered":"2026-02-22T22:17:57.214164+0000","last_unstale":"2026-02-22T22:30:30.080022+0000","last_undegraded":"2026-02-22T22:30:30.080022+0000","last_fullsized":"2026-02-22T22:30:30.080022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:37:18.081861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011410280000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.045592+0000","last_change":"2026-02-22T22:17:59.060445+0000","last_active":"2026-02-22T22:30:30.045592+0000","last_peered":"2026-02-22T22:30:30.045592+0000","last_clean":"2026-02-22T22:30:30.045592+0000","last_became_active":"2026-02-22T22:17:57.190205+0000","last_became_peered":"2026-02-22T22:17:57.190205+0000","last_unstale":"2026-02-22T22:30:30.045592+0000","last_undegraded":"2026-02-22T22:30:30.045592+0000","last_fullsized":"2026-02-22T22:30:30.045592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:45:07.425114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000249304,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.080173+0000","last_change":"2026-02-22T22:17:59.219262+0000","last_active":"2026-02-22T22:30:30.080173+0000","last_peered":"2026-02-22T22:30:30.080173+0000","last_clean":"2026-02-22T22:30:30.080173+0000","last_became_active":"2026-02-22T22:17:57.116722+0000","last_became_peered":"2026-02-22T22:17:57.116722+0000","last_unstale":"2026-02-22T22:30:30.080173+0000","last_undegraded":"2026-02-22T22:30:30.080173+0000","last_fullsized":"2026-02-22T22:30:30.080173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:09:46.687325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10066288900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6],"acting":[3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":103,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.083099+0000","last_change":"2026-02-22T22:17:59.019611+0000","last_active":"2026-02-22T22:30:30.083099+0000","last_peered":"2026-02-22T22:30:30.083099+0000","last_clean":"2026-02-22T22:30:30.083099+0000","last_became_active":"2026-02-22T22:17:57.369042+0000","last_became_peered":"2026-02-22T22:17:57.369042+0000","last_unstale":"2026-02-22T22:30:30.083099+0000","last_undegraded":"2026-02-22T22:30:30.083099+0000","last_fullsized":"2026-02-22T22:30:30.083099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:27:03.006376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033978200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":103,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.080227+0000","last_change":"2026-02-22T22:17:59.319241+0000","last_active":"2026-02-22T22:30:30.080227+0000","last_peered":"2026-02-22T22:30:30.080227+0000","last_clean":"2026-02-22T22:30:30.080227+0000","last_became_active":"2026-02-22T22:17:57.368465+0000","last_became_peered":"2026-02-22T22:17:57.368465+0000","last_unstale":"2026-02-22T22:30:30.080227+0000","last_undegraded":"2026-02-22T22:30:30.080227+0000","last_fullsized":"2026-02-22T22:30:30.080227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:25:53.847732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100604244,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542318,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36012,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35262,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":749568,"data_stored":318638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36108743},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542319,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72104,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299736,"statfs":{"total":96636764160,"available":96562929664,"internally_reserved":0,"allocated":745472,"data_stored":318619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,4,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542317,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67948,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94303892,"statfs":{"total":96636764160,"available":96567185408,"internally_reserved":0,"allocated":749568,"data_stored":318638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":68811208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,5,0,0,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542319,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58736,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":57470,"kb_avail":94313104,"statfs":{"total":96636764160,"available":96576618496,"internally_reserved":0,"allocated":1277952,"data_stored":847547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58849734},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542318,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54580,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":94317260,"statfs":{"total":96636764160,"available":96580874240,"internally_reserved":0,"allocated":1282048,"data_stored":847566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542318,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58216,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":57470,"kb_avail":94313624,"statfs":{"total":96636764160,"available":96577150976,"internally_reserved":0,"allocated":745472,"data_stored":318619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58849734},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,4,0,0,2,2,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542318,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68464,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94303376,"statfs":{"total":96636764160,"available":96566657024,"internally_reserved":0,"allocated":1277952,"data_stored":847547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,2,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575022,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58216,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":57470,"kb_avail":94313624,"statfs":{"total":96636764160,"available":96577150976,"internally_reserved":0,"allocated":745472,"data_stored":318619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58849739},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T22:32:14.563 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-22T22:32:14.719 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:32:14.719 INFO:teuthology.orchestra.run.trial061.stdout:{"epoch":63,"fsid":"24d9e668-2d30-4315-9561-54e0490ce85f","created":"2026-02-22T22:17:38.924017+0000","modified":"2026-02-22T22:32:14.055165+0000","last_up_change":"2026-02-22T22:17:49.978963+0000","last_in_change":"2026-02-22T22:17:40.160895+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"reef","min_compat_client":"reef","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-22T22:17:50.928809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-22T22:17:55.257743+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5cb2e913-8f85-41b4-8d7b-d0d8389c1d9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6800","nonce":2039210781},{"type":"v1","addr":"10.20.193.61:6801","nonce":2039210781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6802","nonce":2039210781},{"type":"v1","addr":"10.20.193.61:6803","nonce":2039210781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6806","nonce":2039210781},{"type":"v1","addr":"10.20.193.61:6807","nonce":2039210781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6804","nonce":2039210781},{"type":"v1","addr":"10.20.193.61:6805","nonce":2039210781}]},"public_addr":"10.20.193.61:6801/2039210781","cluster_addr":"10.20.193.61:6803/2039210781","heartbeat_back_addr":"10.20.193.61:6807/2039210781","heartbeat_front_addr":"10.20.193.61:6805/2039210781","state":["exists","up"]},{"osd":1,"uuid":"b819c43c-51c0-4876-b7ce-83ad9359eb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6808","nonce":1753439961},{"type":"v1","addr":"10.20.193.61:6809","nonce":1753439961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6810","nonce":1753439961},{"type":"v1","addr":"10.20.193.61:6811","nonce":1753439961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6814","nonce":1753439961},{"type":"v1","addr":"10.20.193.61:6815","nonce":1753439961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6812","nonce":1753439961},{"type":"v1","addr":"10.20.193.61:6813","nonce":1753439961}]},"public_addr":"10.20.193.61:6809/1753439961","cluster_addr":"10.20.193.61:6811/1753439961","heartbeat_back_addr":"10.20.193.61:6815/1753439961","heartbeat_front_addr":"10.20.193.61:6813/1753439961","state":["exists","up"]},{"osd":2,"uuid":"3ac06a05-4325-43fb-9395-6063e1207949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6816","nonce":3859179519},{"type":"v1","addr":"10.20.193.61:6817","nonce":3859179519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6818","nonce":3859179519},{"type":"v1","addr":"10.20.193.61:6819","nonce":3859179519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6822","nonce":3859179519},{"type":"v1","addr":"10.20.193.61:6823","nonce":3859179519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6820","nonce":3859179519},{"type":"v1","addr":"10.20.193.61:6821","nonce":3859179519}]},"public_addr":"10.20.193.61:6817/3859179519","cluster_addr":"10.20.193.61:6819/3859179519","heartbeat_back_addr":"10.20.193.61:6823/3859179519","heartbeat_front_addr":"10.20.193.61:6821/3859179519","state":["exists","up"]},{"osd":3,"uuid":"b787eaaa-95af-46ac-bfcf-2ff3f3f96747","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6824","nonce":865615267},{"type":"v1","addr":"10.20.193.61:6825","nonce":865615267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6826","nonce":865615267},{"type":"v1","addr":"10.20.193.61:6827","nonce":865615267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6830","nonce":865615267},{"type":"v1","addr":"10.20.193.61:6831","nonce":865615267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.61:6828","nonce":865615267},{"type":"v1","addr":"10.20.193.61:6829","nonce":865615267}]},"public_addr":"10.20.193.61:6825/865615267","cluster_addr":"10.20.193.61:6827/865615267","heartbeat_back_addr":"10.20.193.61:6831/865615267","heartbeat_front_addr":"10.20.193.61:6829/865615267","state":["exists","up"]},{"osd":4,"uuid":"aba57c87-45bb-4117-acbc-6844f4a59ec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6818","nonce":1598909919},{"type":"v1","addr":"10.20.193.101:6819","nonce":1598909919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6820","nonce":1598909919},{"type":"v1","addr":"10.20.193.101:6821","nonce":1598909919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6824","nonce":1598909919},{"type":"v1","addr":"10.20.193.101:6825","nonce":1598909919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6822","nonce":1598909919},{"type":"v1","addr":"10.20.193.101:6823","nonce":1598909919}]},"public_addr":"10.20.193.101:6819/1598909919","cluster_addr":"10.20.193.101:6821/1598909919","heartbeat_back_addr":"10.20.193.101:6825/1598909919","heartbeat_front_addr":"10.20.193.101:6823/1598909919","state":["exists","up"]},{"osd":5,"uuid":"8416820d-19ef-4a33-bbb7-648f325200cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6826","nonce":2416213060},{"type":"v1","addr":"10.20.193.101:6827","nonce":2416213060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6828","nonce":2416213060},{"type":"v1","addr":"10.20.193.101:6829","nonce":2416213060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6832","nonce":2416213060},{"type":"v1","addr":"10.20.193.101:6833","nonce":2416213060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6830","nonce":2416213060},{"type":"v1","addr":"10.20.193.101:6831","nonce":2416213060}]},"public_addr":"10.20.193.101:6827/2416213060","cluster_addr":"10.20.193.101:6829/2416213060","heartbeat_back_addr":"10.20.193.101:6833/2416213060","heartbeat_front_addr":"10.20.193.101:6831/2416213060","state":["exists","up"]},{"osd":6,"uuid":"9d6a92a6-838b-4321-9d6b-3f2ca4c147f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6810","nonce":1454564281},{"type":"v1","addr":"10.20.193.101:6811","nonce":1454564281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6812","nonce":1454564281},{"type":"v1","addr":"10.20.193.101:6813","nonce":1454564281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6816","nonce":1454564281},{"type":"v1","addr":"10.20.193.101:6817","nonce":1454564281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6814","nonce":1454564281},{"type":"v1","addr":"10.20.193.101:6815","nonce":1454564281}]},"public_addr":"10.20.193.101:6811/1454564281","cluster_addr":"10.20.193.101:6813/1454564281","heartbeat_back_addr":"10.20.193.101:6817/1454564281","heartbeat_front_addr":"10.20.193.101:6815/1454564281","state":["exists","up"]},{"osd":7,"uuid":"8506f3da-648f-4271-88fa-2310fcb551f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6802","nonce":2507111659},{"type":"v1","addr":"10.20.193.101:6803","nonce":2507111659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6804","nonce":2507111659},{"type":"v1","addr":"10.20.193.101:6805","nonce":2507111659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6808","nonce":2507111659},{"type":"v1","addr":"10.20.193.101:6809","nonce":2507111659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.101:6806","nonce":2507111659},{"type":"v1","addr":"10.20.193.101:6807","nonce":2507111659}]},"public_addr":"10.20.193.101:6803/2507111659","cluster_addr":"10.20.193.101:6805/2507111659","heartbeat_back_addr":"10.20.193.101:6809/2507111659","heartbeat_front_addr":"10.20.193.101:6807/2507111659","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:17:48.069234+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:17:48.195258+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:17:48.227940+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:17:48.270215+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:17:48.139039+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:17:48.271670+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:17:48.038799+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-22T22:17:47.887238+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[{"pgid":"2.0","primary_osd":5},{"pgid":"2.3","primary_osd":4}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-22T22:32:15.731 INFO:tasks.ceph:Scrubbing osd.0 2026-02-22T22:32:15.731 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-22T22:32:15.816 INFO:teuthology.orchestra.run.trial061.stdout:{ 2026-02-22T22:32:15.816 INFO:teuthology.orchestra.run.trial061.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-22T22:32:15.816 INFO:teuthology.orchestra.run.trial061.stdout:} 2026-02-22T22:32:15.825 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-22T22:32:15.969 INFO:teuthology.orchestra.run.trial061.stderr:instructed osd(s) 0 to deep-scrub 2026-02-22T22:32:15.980 INFO:tasks.ceph:Scrubbing osd.1 2026-02-22T22:32:15.980 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-22T22:32:16.056 INFO:teuthology.orchestra.run.trial061.stdout:{ 2026-02-22T22:32:16.056 INFO:teuthology.orchestra.run.trial061.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-22T22:32:16.056 INFO:teuthology.orchestra.run.trial061.stdout:} 2026-02-22T22:32:16.065 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-22T22:32:16.210 INFO:teuthology.orchestra.run.trial061.stderr:instructed osd(s) 1 to deep-scrub 2026-02-22T22:32:16.220 INFO:tasks.ceph:Scrubbing osd.2 2026-02-22T22:32:16.220 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-22T22:32:16.304 INFO:teuthology.orchestra.run.trial061.stdout:{ 2026-02-22T22:32:16.304 INFO:teuthology.orchestra.run.trial061.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-22T22:32:16.304 INFO:teuthology.orchestra.run.trial061.stdout:} 2026-02-22T22:32:16.312 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-22T22:32:16.456 INFO:teuthology.orchestra.run.trial061.stderr:instructed osd(s) 2 to deep-scrub 2026-02-22T22:32:16.466 INFO:tasks.ceph:Scrubbing osd.3 2026-02-22T22:32:16.466 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-22T22:32:16.551 INFO:teuthology.orchestra.run.trial061.stdout:{ 2026-02-22T22:32:16.551 INFO:teuthology.orchestra.run.trial061.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-22T22:32:16.552 INFO:teuthology.orchestra.run.trial061.stdout:} 2026-02-22T22:32:16.561 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-22T22:32:16.708 INFO:teuthology.orchestra.run.trial061.stderr:instructed osd(s) 3 to deep-scrub 2026-02-22T22:32:16.718 INFO:tasks.ceph:Scrubbing osd.4 2026-02-22T22:32:16.719 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-22T22:32:16.801 INFO:teuthology.orchestra.run.trial061.stdout:{ 2026-02-22T22:32:16.801 INFO:teuthology.orchestra.run.trial061.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T22:32:16.801 INFO:teuthology.orchestra.run.trial061.stdout:} 2026-02-22T22:32:16.810 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-22T22:32:16.956 INFO:teuthology.orchestra.run.trial061.stderr:instructed osd(s) 4 to deep-scrub 2026-02-22T22:32:16.966 INFO:tasks.ceph:Scrubbing osd.5 2026-02-22T22:32:16.966 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-22T22:32:17.039 INFO:teuthology.orchestra.run.trial061.stdout:{ 2026-02-22T22:32:17.039 INFO:teuthology.orchestra.run.trial061.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-22T22:32:17.039 INFO:teuthology.orchestra.run.trial061.stdout:} 2026-02-22T22:32:17.048 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-22T22:32:17.193 INFO:teuthology.orchestra.run.trial061.stderr:instructed osd(s) 5 to deep-scrub 2026-02-22T22:32:17.204 INFO:tasks.ceph:Scrubbing osd.6 2026-02-22T22:32:17.204 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2026-02-22T22:32:17.281 INFO:teuthology.orchestra.run.trial061.stdout:{ 2026-02-22T22:32:17.282 INFO:teuthology.orchestra.run.trial061.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-22T22:32:17.282 INFO:teuthology.orchestra.run.trial061.stdout:} 2026-02-22T22:32:17.291 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2026-02-22T22:32:17.441 INFO:teuthology.orchestra.run.trial061.stderr:instructed osd(s) 6 to deep-scrub 2026-02-22T22:32:17.452 INFO:tasks.ceph:Scrubbing osd.7 2026-02-22T22:32:17.452 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2026-02-22T22:32:17.535 INFO:teuthology.orchestra.run.trial061.stdout:{ 2026-02-22T22:32:17.535 INFO:teuthology.orchestra.run.trial061.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-22T22:32:17.535 INFO:teuthology.orchestra.run.trial061.stdout:} 2026-02-22T22:32:17.544 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2026-02-22T22:32:17.689 INFO:teuthology.orchestra.run.trial061.stderr:instructed osd(s) 7 to deep-scrub 2026-02-22T22:32:17.700 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T22:32:17.848 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:32:17.849 INFO:teuthology.orchestra.run.trial061.stderr:dumped all 2026-02-22T22:32:17.858 INFO:teuthology.orchestra.run.trial061.stdout:{"pg_ready":true,"pg_map":{"version":490,"stamp":"2026-02-22T22:32:16.993446+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":474316,"kb_used_data":7428,"kb_used_omap":12,"kb_used_meta":466739,"kb_avail":754500404,"statfs":{"total":773094113280,"available":772608413696,"internally_reserved":0,"allocated":7606272,"data_stored":4147435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":477941304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-16572440,"num_objects":-254,"num_object_clones":0,"num_object_copies":-762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-254,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-3788,"num_write_kb":-28729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001006"},"pg_stats":[{"pgid":"1.0","version":"23'112","reported_seq":244,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.141583+0000","last_change":"2026-02-22T22:17:52.234714+0000","last_active":"2026-02-22T22:30:30.141583+0000","last_peered":"2026-02-22T22:30:30.141583+0000","last_clean":"2026-02-22T22:30:30.141583+0000","last_became_active":"2026-02-22T22:17:52.233814+0000","last_became_peered":"2026-02-22T22:17:52.233814+0000","last_unstale":"2026-02-22T22:30:30.141583+0000","last_undegraded":"2026-02-22T22:30:30.141583+0000","last_fullsized":"2026-02-22T22:30:30.141583+0000","mapping_epoch":15,"log_start":"23'109","ondisk_log_start":"23'109","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:50.983542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:50.983542+0000","last_clean_scrub_stamp":"2026-02-22T22:17:50.983542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":109,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:48:32.581514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,2],"acting":[1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":96,"reported_epoch":63,"state":"active+clean","last_fresh":"2026-02-22T22:32:14.197997+0000","last_change":"2026-02-22T22:18:05.904451+0000","last_active":"2026-02-22T22:32:14.197997+0000","last_peered":"2026-02-22T22:32:14.197997+0000","last_clean":"2026-02-22T22:32:14.197997+0000","last_became_active":"2026-02-22T22:18:05.904243+0000","last_became_peered":"2026-02-22T22:18:05.904243+0000","last_unstale":"2026-02-22T22:32:14.197997+0000","last_undegraded":"2026-02-22T22:32:14.197997+0000","last_fullsized":"2026-02-22T22:32:14.197997+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T22:51:37.892449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3],"acting":[4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.245591+0000","last_change":"2026-02-22T22:18:06.003569+0000","last_active":"2026-02-22T22:30:30.245591+0000","last_peered":"2026-02-22T22:30:30.245591+0000","last_clean":"2026-02-22T22:30:30.245591+0000","last_became_active":"2026-02-22T22:18:06.003368+0000","last_became_peered":"2026-02-22T22:18:06.003368+0000","last_unstale":"2026-02-22T22:30:30.245591+0000","last_undegraded":"2026-02-22T22:30:30.245591+0000","last_fullsized":"2026-02-22T22:30:30.245591+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:32:51.942219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":106,"reported_epoch":63,"state":"active+clean","last_fresh":"2026-02-22T22:32:14.169232+0000","last_change":"2026-02-22T22:17:59.246693+0000","last_active":"2026-02-22T22:32:14.169232+0000","last_peered":"2026-02-22T22:32:14.169232+0000","last_clean":"2026-02-22T22:32:14.169232+0000","last_became_active":"2026-02-22T22:17:57.217004+0000","last_became_peered":"2026-02-22T22:17:57.217004+0000","last_unstale":"2026-02-22T22:32:14.169232+0000","last_undegraded":"2026-02-22T22:32:14.169232+0000","last_fullsized":"2026-02-22T22:32:14.169232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-23T23:16:26.325314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10045264499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":107,"reported_epoch":63,"state":"active+clean","last_fresh":"2026-02-22T22:32:14.059356+0000","last_change":"2026-02-22T22:17:59.119704+0000","last_active":"2026-02-22T22:32:14.059356+0000","last_peered":"2026-02-22T22:32:14.059356+0000","last_clean":"2026-02-22T22:32:14.059356+0000","last_became_active":"2026-02-22T22:17:57.214164+0000","last_became_peered":"2026-02-22T22:17:57.214164+0000","last_unstale":"2026-02-22T22:32:14.059356+0000","last_undegraded":"2026-02-22T22:32:14.059356+0000","last_fullsized":"2026-02-22T22:32:14.059356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:37:18.081861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011410280000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":62,"state":"active+clean","last_fresh":"2026-02-22T22:30:30.045592+0000","last_change":"2026-02-22T22:17:59.060445+0000","last_active":"2026-02-22T22:30:30.045592+0000","last_peered":"2026-02-22T22:30:30.045592+0000","last_clean":"2026-02-22T22:30:30.045592+0000","last_became_active":"2026-02-22T22:17:57.190205+0000","last_became_peered":"2026-02-22T22:17:57.190205+0000","last_unstale":"2026-02-22T22:30:30.045592+0000","last_undegraded":"2026-02-22T22:30:30.045592+0000","last_fullsized":"2026-02-22T22:30:30.045592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T04:45:07.425114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000249304,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":105,"reported_epoch":63,"state":"active+clean","last_fresh":"2026-02-22T22:32:14.060062+0000","last_change":"2026-02-22T22:17:59.219262+0000","last_active":"2026-02-22T22:32:14.060062+0000","last_peered":"2026-02-22T22:32:14.060062+0000","last_clean":"2026-02-22T22:32:14.060062+0000","last_became_active":"2026-02-22T22:17:57.116722+0000","last_became_peered":"2026-02-22T22:17:57.116722+0000","last_unstale":"2026-02-22T22:32:14.060062+0000","last_undegraded":"2026-02-22T22:32:14.060062+0000","last_fullsized":"2026-02-22T22:32:14.060062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:09:46.687325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10066288900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6],"acting":[3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":105,"reported_epoch":63,"state":"active+clean","last_fresh":"2026-02-22T22:32:14.197439+0000","last_change":"2026-02-22T22:17:59.019611+0000","last_active":"2026-02-22T22:32:14.197439+0000","last_peered":"2026-02-22T22:32:14.197439+0000","last_clean":"2026-02-22T22:32:14.197439+0000","last_became_active":"2026-02-22T22:17:57.369042+0000","last_became_peered":"2026-02-22T22:17:57.369042+0000","last_unstale":"2026-02-22T22:32:14.197439+0000","last_undegraded":"2026-02-22T22:32:14.197439+0000","last_fullsized":"2026-02-22T22:32:14.197439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:27:03.006376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033978200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":105,"reported_epoch":63,"state":"active+clean","last_fresh":"2026-02-22T22:32:14.060084+0000","last_change":"2026-02-22T22:17:59.319241+0000","last_active":"2026-02-22T22:32:14.060084+0000","last_peered":"2026-02-22T22:32:14.060084+0000","last_clean":"2026-02-22T22:32:14.060084+0000","last_became_active":"2026-02-22T22:17:57.368465+0000","last_became_peered":"2026-02-22T22:17:57.368465+0000","last_unstale":"2026-02-22T22:32:14.060084+0000","last_undegraded":"2026-02-22T22:32:14.060084+0000","last_fullsized":"2026-02-22T22:32:14.060084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:17:56.001685+0000","last_clean_scrub_stamp":"2026-02-22T22:17:56.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:25:53.847732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100604244,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542318,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36012,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35262,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":749568,"data_stored":318638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36108743},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542320,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72124,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299716,"statfs":{"total":96636764160,"available":96562909184,"internally_reserved":0,"allocated":761856,"data_stored":324440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542318,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67948,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94303892,"statfs":{"total":96636764160,"available":96567185408,"internally_reserved":0,"allocated":749568,"data_stored":318638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":68811208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542319,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58736,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":57470,"kb_avail":94313104,"statfs":{"total":96636764160,"available":96576618496,"internally_reserved":0,"allocated":1277952,"data_stored":847547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58849734},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542318,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54580,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":94317260,"statfs":{"total":96636764160,"available":96580874240,"internally_reserved":0,"allocated":1282048,"data_stored":847566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542319,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58216,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":57470,"kb_avail":94313624,"statfs":{"total":96636764160,"available":96577150976,"internally_reserved":0,"allocated":745472,"data_stored":318619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58849734},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542319,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68464,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94303376,"statfs":{"total":96636764160,"available":96566657024,"internally_reserved":0,"allocated":1277952,"data_stored":847547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575023,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58236,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":57470,"kb_avail":94313604,"statfs":{"total":96636764160,"available":96577130496,"internally_reserved":0,"allocated":761856,"data_stored":324440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58849739},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T22:32:17.862 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-22T22:17:50.983542+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=17, tm_sec=50, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=32, tm_sec=14, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:32:17.863 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-22T22:17:56.001685+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=17, tm_sec=56, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=32, tm_sec=14, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:32:17.863 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-22T22:17:56.001685+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=17, tm_sec=56, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=32, tm_sec=14, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:32:17.863 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-22T22:17:56.001685+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=17, tm_sec=56, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=32, tm_sec=14, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:32:17.863 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-22T22:17:56.001685+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=17, tm_sec=56, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=32, tm_sec=14, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:32:17.863 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-22T22:17:56.001685+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=17, tm_sec=56, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=32, tm_sec=14, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:32:17.863 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-22T22:17:56.001685+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=17, tm_sec=56, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=32, tm_sec=14, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:32:17.863 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-22T22:17:56.001685+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=17, tm_sec=56, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=32, tm_sec=14, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:32:17.863 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-22T22:17:56.001685+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=17, tm_sec=56, tm_wday=6, tm_yday=53, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=22, tm_hour=22, tm_min=32, tm_sec=14, tm_wday=6, tm_yday=53, tm_isdst=0) 2026-02-22T22:32:17.863 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-22T22:32:37.864 DEBUG:teuthology.orchestra.run.trial061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-22T22:32:38.019 INFO:teuthology.orchestra.run.trial061.stdout: 2026-02-22T22:32:38.019 INFO:teuthology.orchestra.run.trial061.stderr:dumped all 2026-02-22T22:32:38.029 INFO:teuthology.orchestra.run.trial061.stdout:{"pg_ready":true,"pg_map":{"version":500,"stamp":"2026-02-22T22:32:36.995170+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":474404,"kb_used_data":7524,"kb_used_omap":12,"kb_used_meta":466739,"kb_avail":754500316,"statfs":{"total":773094113280,"available":772608323584,"internally_reserved":0,"allocated":7704576,"data_stored":4182361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":477941304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001034"},"pg_stats":[{"pgid":"1.0","version":"63'114","reported_seq":257,"reported_epoch":63,"state":"active+clean","last_fresh":"2026-02-22T22:32:17.252375+0000","last_change":"2026-02-22T22:32:17.252417+0000","last_active":"2026-02-22T22:32:17.252375+0000","last_peered":"2026-02-22T22:32:17.252375+0000","last_clean":"2026-02-22T22:32:17.252375+0000","last_became_active":"2026-02-22T22:17:52.233814+0000","last_became_peered":"2026-02-22T22:17:52.233814+0000","last_unstale":"2026-02-22T22:32:17.252375+0000","last_undegraded":"2026-02-22T22:32:17.252375+0000","last_fullsized":"2026-02-22T22:32:17.252375+0000","mapping_epoch":15,"log_start":"23'111","ondisk_log_start":"23'111","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'114","last_scrub_stamp":"2026-02-22T22:32:17.252318+0000","last_deep_scrub":"63'114","last_deep_scrub_stamp":"2026-02-22T22:32:17.252318+0000","last_clean_scrub_stamp":"2026-02-22T22:32:17.252318+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":111,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T03:25:26.906688+0000","scrub_duration":203,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,2],"acting":[1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"63'2","reported_seq":106,"reported_epoch":63,"state":"active+clean","last_fresh":"2026-02-22T22:32:18.485541+0000","last_change":"2026-02-22T22:32:18.485561+0000","last_active":"2026-02-22T22:32:18.485541+0000","last_peered":"2026-02-22T22:32:18.485541+0000","last_clean":"2026-02-22T22:32:18.485541+0000","last_became_active":"2026-02-22T22:18:05.904243+0000","last_became_peered":"2026-02-22T22:18:05.904243+0000","last_unstale":"2026-02-22T22:32:18.485541+0000","last_undegraded":"2026-02-22T22:32:18.485541+0000","last_fullsized":"2026-02-22T22:32:18.485541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2026-02-22T22:32:18.485468+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2026-02-22T22:32:18.485468+0000","last_clean_scrub_stamp":"2026-02-22T22:32:18.485468+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T06:00:07.741631+0000","scrub_duration":303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3],"acting":[4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2026-02-22T22:32:19.049985+0000","last_change":"2026-02-22T22:32:19.050016+0000","last_active":"2026-02-22T22:32:19.049985+0000","last_peered":"2026-02-22T22:32:19.049985+0000","last_clean":"2026-02-22T22:32:19.049985+0000","last_became_active":"2026-02-22T22:18:06.003368+0000","last_became_peered":"2026-02-22T22:18:06.003368+0000","last_unstale":"2026-02-22T22:32:19.049985+0000","last_undegraded":"2026-02-22T22:32:19.049985+0000","last_fullsized":"2026-02-22T22:32:19.049985+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:32:19.049902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:32:19.049902+0000","last_clean_scrub_stamp":"2026-02-22T22:32:19.049902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T02:01:46.687252+0000","scrub_duration":203,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":116,"reported_epoch":63,"state":"active+clean","last_fresh":"2026-02-22T22:32:18.575778+0000","last_change":"2026-02-22T22:32:18.575778+0000","last_active":"2026-02-22T22:32:18.575778+0000","last_peered":"2026-02-22T22:32:18.575778+0000","last_clean":"2026-02-22T22:32:18.575778+0000","last_became_active":"2026-02-22T22:17:57.217004+0000","last_became_peered":"2026-02-22T22:17:57.217004+0000","last_unstale":"2026-02-22T22:32:18.575778+0000","last_undegraded":"2026-02-22T22:32:18.575778+0000","last_fullsized":"2026-02-22T22:32:18.575778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:32:18.575708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:32:18.575708+0000","last_clean_scrub_stamp":"2026-02-22T22:32:18.575708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:21:25.251192+0000","scrub_duration":199,"objects_trimmed":0,"snaptrim_duration":0.10045264499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"63'3","reported_seq":117,"reported_epoch":63,"state":"active+clean","last_fresh":"2026-02-22T22:32:18.122157+0000","last_change":"2026-02-22T22:32:18.122180+0000","last_active":"2026-02-22T22:32:18.122157+0000","last_peered":"2026-02-22T22:32:18.122157+0000","last_clean":"2026-02-22T22:32:18.122157+0000","last_became_active":"2026-02-22T22:17:57.214164+0000","last_became_peered":"2026-02-22T22:17:57.214164+0000","last_unstale":"2026-02-22T22:32:18.122157+0000","last_undegraded":"2026-02-22T22:32:18.122157+0000","last_fullsized":"2026-02-22T22:32:18.122157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'3","last_scrub_stamp":"2026-02-22T22:32:18.122112+0000","last_deep_scrub":"63'3","last_deep_scrub_stamp":"2026-02-22T22:32:18.122112+0000","last_clean_scrub_stamp":"2026-02-22T22:32:18.122112+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:44:45.231785+0000","scrub_duration":303,"objects_trimmed":0,"snaptrim_duration":0.0011410280000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":112,"reported_epoch":63,"state":"active+clean","last_fresh":"2026-02-22T22:32:18.258957+0000","last_change":"2026-02-22T22:32:18.258972+0000","last_active":"2026-02-22T22:32:18.258957+0000","last_peered":"2026-02-22T22:32:18.258957+0000","last_clean":"2026-02-22T22:32:18.258957+0000","last_became_active":"2026-02-22T22:17:57.190205+0000","last_became_peered":"2026-02-22T22:17:57.190205+0000","last_unstale":"2026-02-22T22:32:18.258957+0000","last_undegraded":"2026-02-22T22:32:18.258957+0000","last_fullsized":"2026-02-22T22:32:18.258957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:32:18.258905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:32:18.258905+0000","last_clean_scrub_stamp":"2026-02-22T22:32:18.258905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T08:04:03.976386+0000","scrub_duration":303,"objects_trimmed":0,"snaptrim_duration":0.000249304,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":114,"reported_epoch":63,"state":"active+clean","last_fresh":"2026-02-22T22:32:17.209787+0000","last_change":"2026-02-22T22:32:17.209806+0000","last_active":"2026-02-22T22:32:17.209787+0000","last_peered":"2026-02-22T22:32:17.209787+0000","last_clean":"2026-02-22T22:32:17.209787+0000","last_became_active":"2026-02-22T22:17:57.116722+0000","last_became_peered":"2026-02-22T22:17:57.116722+0000","last_unstale":"2026-02-22T22:32:17.209787+0000","last_undegraded":"2026-02-22T22:32:17.209787+0000","last_fullsized":"2026-02-22T22:32:17.209787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:32:17.209717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:32:17.209717+0000","last_clean_scrub_stamp":"2026-02-22T22:32:17.209717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T07:16:17.005968+0000","scrub_duration":403,"objects_trimmed":0,"snaptrim_duration":0.10066288900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6],"acting":[3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":114,"reported_epoch":63,"state":"active+clean","last_fresh":"2026-02-22T22:32:17.250715+0000","last_change":"2026-02-22T22:32:17.250736+0000","last_active":"2026-02-22T22:32:17.250715+0000","last_peered":"2026-02-22T22:32:17.250715+0000","last_clean":"2026-02-22T22:32:17.250715+0000","last_became_active":"2026-02-22T22:17:57.369042+0000","last_became_peered":"2026-02-22T22:17:57.369042+0000","last_unstale":"2026-02-22T22:32:17.250715+0000","last_undegraded":"2026-02-22T22:32:17.250715+0000","last_fullsized":"2026-02-22T22:32:17.250715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:32:17.250652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:32:17.250652+0000","last_clean_scrub_stamp":"2026-02-22T22:32:17.250652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T00:33:23.635724+0000","scrub_duration":103,"objects_trimmed":0,"snaptrim_duration":0.00033978200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":114,"reported_epoch":63,"state":"active+clean","last_fresh":"2026-02-22T22:32:19.061074+0000","last_change":"2026-02-22T22:32:19.061094+0000","last_active":"2026-02-22T22:32:19.061074+0000","last_peered":"2026-02-22T22:32:19.061074+0000","last_clean":"2026-02-22T22:32:19.061074+0000","last_became_active":"2026-02-22T22:17:57.368465+0000","last_became_peered":"2026-02-22T22:17:57.368465+0000","last_unstale":"2026-02-22T22:32:19.061074+0000","last_undegraded":"2026-02-22T22:32:19.061074+0000","last_fullsized":"2026-02-22T22:32:19.061074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-22T22:32:19.061020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-22T22:32:19.061020+0000","last_clean_scrub_stamp":"2026-02-22T22:32:19.061020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-24T01:11:47.089030+0000","scrub_duration":199,"objects_trimmed":0,"snaptrim_duration":0.100604244,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":24,"acting":24,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542322,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36028,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":35262,"kb_avail":94335812,"statfs":{"total":96636764160,"available":96599871488,"internally_reserved":0,"allocated":765952,"data_stored":324459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36108743},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542324,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72120,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299720,"statfs":{"total":96636764160,"available":96562913280,"internally_reserved":0,"allocated":761856,"data_stored":324440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542322,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67964,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94303876,"statfs":{"total":96636764160,"available":96567169024,"internally_reserved":0,"allocated":765952,"data_stored":324459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":68811208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542323,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58752,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":57470,"kb_avail":94313088,"statfs":{"total":96636764160,"available":96576602112,"internally_reserved":0,"allocated":1294336,"data_stored":853368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58849734},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542322,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54596,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":53310,"kb_avail":94317244,"statfs":{"total":96636764160,"available":96580857856,"internally_reserved":0,"allocated":1298432,"data_stored":853387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54589894},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542323,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58232,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":57470,"kb_avail":94313608,"statfs":{"total":96636764160,"available":96577134592,"internally_reserved":0,"allocated":761856,"data_stored":324440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58849734},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542323,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68480,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94303360,"statfs":{"total":96636764160,"available":96566640640,"internally_reserved":0,"allocated":1294336,"data_stored":853368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834575027,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58232,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":57470,"kb_avail":94313608,"statfs":{"total":96636764160,"available":96577134592,"internally_reserved":0,"allocated":761856,"data_stored":324440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":58849739},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-22T22:32:38.031 DEBUG:teuthology.orchestra.run.trial061:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-22T22:32:38.186 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-22T22:32:38.186 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-22T22:32:38.187 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-22T22:32:38.187 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:32:38.265 INFO:tasks.ceph.osd.0:Stopped 2026-02-22T22:32:38.266 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-22T22:32:38.266 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:32:38.334 INFO:tasks.ceph.osd.1:Stopped 2026-02-22T22:32:38.335 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-22T22:32:38.335 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:32:38.434 INFO:tasks.ceph.osd.2:Stopped 2026-02-22T22:32:38.435 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-22T22:32:38.435 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:32:38.518 INFO:tasks.ceph.osd.3:Stopped 2026-02-22T22:32:38.518 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-22T22:32:38.518 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:32:38.598 INFO:tasks.ceph.osd.4:Stopped 2026-02-22T22:32:38.598 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-22T22:32:38.598 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:32:38.676 INFO:tasks.ceph.osd.5:Stopped 2026-02-22T22:32:38.676 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2026-02-22T22:32:38.676 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:32:38.755 INFO:tasks.ceph.osd.6:Stopped 2026-02-22T22:32:38.755 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2026-02-22T22:32:38.755 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:32:38.839 INFO:tasks.ceph.osd.7:Stopped 2026-02-22T22:32:38.839 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-22T22:32:38.839 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-22T22:32:38.839 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:32:38.868 INFO:tasks.ceph.mgr.y:Stopped 2026-02-22T22:32:38.868 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-22T22:32:38.868 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:32:38.909 INFO:tasks.ceph.mgr.x:Stopped 2026-02-22T22:32:38.909 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-22T22:32:38.910 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-22T22:32:38.910 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:32:38.922 INFO:tasks.ceph.mon.a:Stopped 2026-02-22T22:32:38.923 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-22T22:32:38.923 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:32:38.977 INFO:tasks.ceph.mon.c:Stopped 2026-02-22T22:32:38.977 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-22T22:32:38.977 INFO:teuthology.orchestra.run:waiting for 300 2026-02-22T22:32:38.990 INFO:tasks.ceph.mon.b:Stopped 2026-02-22T22:32:38.991 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-22T22:32:38.991 DEBUG:teuthology.orchestra.run.trial061:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | egrep -v 'is down' | egrep -v 'osds down' | egrep -v 'pg .*? is .*?degraded.*?, acting' | egrep -v 'pg .*? is stuck' | egrep -v 'pg degraded' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | head -n 1 2026-02-22T22:32:39.031 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial061.front.sepia.ceph.com 2026-02-22T22:32:39.031 DEBUG:teuthology.orchestra.run.trial061:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-22T22:32:39.085 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial061.front.sepia.ceph.com 2026-02-22T22:32:39.085 DEBUG:teuthology.orchestra.run.trial061:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-22T22:32:39.142 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial061.front.sepia.ceph.com 2026-02-22T22:32:39.143 DEBUG:teuthology.orchestra.run.trial061:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-22T22:32:39.198 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial061.front.sepia.ceph.com 2026-02-22T22:32:39.198 DEBUG:teuthology.orchestra.run.trial061:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-22T22:32:39.254 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial101.front.sepia.ceph.com 2026-02-22T22:32:39.254 DEBUG:teuthology.orchestra.run.trial101:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-22T22:32:39.272 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial101.front.sepia.ceph.com 2026-02-22T22:32:39.272 DEBUG:teuthology.orchestra.run.trial101:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-22T22:32:39.330 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@trial101.front.sepia.ceph.com 2026-02-22T22:32:39.330 DEBUG:teuthology.orchestra.run.trial101:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2026-02-22T22:32:39.384 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@trial101.front.sepia.ceph.com 2026-02-22T22:32:39.384 DEBUG:teuthology.orchestra.run.trial101:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2026-02-22T22:32:39.441 INFO:tasks.ceph:Archiving mon data... 2026-02-22T22:32:39.443 DEBUG:teuthology.misc:Transferring archived files from trial061:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64197/data/mon.a.tgz 2026-02-22T22:32:39.443 DEBUG:teuthology.orchestra.run.trial061:> mktemp 2026-02-22T22:32:39.448 INFO:teuthology.orchestra.run.trial061.stdout:/tmp/tmp.QDjaMStgTf 2026-02-22T22:32:39.448 DEBUG:teuthology.orchestra.run.trial061:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.QDjaMStgTf 2026-02-22T22:32:39.533 DEBUG:teuthology.orchestra.run.trial061:> sudo chmod 0666 /tmp/tmp.QDjaMStgTf 2026-02-22T22:32:39.630 DEBUG:teuthology.orchestra.remote:trial061:/tmp/tmp.QDjaMStgTf is 303KB 2026-02-22T22:32:39.687 DEBUG:teuthology.orchestra.run.trial061:> rm -fr /tmp/tmp.QDjaMStgTf 2026-02-22T22:32:39.691 DEBUG:teuthology.misc:Transferring archived files from trial061:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64197/data/mon.c.tgz 2026-02-22T22:32:39.692 DEBUG:teuthology.orchestra.run.trial061:> mktemp 2026-02-22T22:32:39.740 INFO:teuthology.orchestra.run.trial061.stdout:/tmp/tmp.r3XAZCxfJr 2026-02-22T22:32:39.741 DEBUG:teuthology.orchestra.run.trial061:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.r3XAZCxfJr 2026-02-22T22:32:39.824 DEBUG:teuthology.orchestra.run.trial061:> sudo chmod 0666 /tmp/tmp.r3XAZCxfJr 2026-02-22T22:32:39.924 DEBUG:teuthology.orchestra.remote:trial061:/tmp/tmp.r3XAZCxfJr is 303KB 2026-02-22T22:32:40.018 DEBUG:teuthology.orchestra.run.trial061:> rm -fr /tmp/tmp.r3XAZCxfJr 2026-02-22T22:32:40.021 DEBUG:teuthology.misc:Transferring archived files from trial101:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64197/data/mon.b.tgz 2026-02-22T22:32:40.021 DEBUG:teuthology.orchestra.run.trial101:> mktemp 2026-02-22T22:32:40.024 INFO:teuthology.orchestra.run.trial101.stdout:/tmp/tmp.5tS8KvrpNu 2026-02-22T22:32:40.024 DEBUG:teuthology.orchestra.run.trial101:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.5tS8KvrpNu 2026-02-22T22:32:40.112 DEBUG:teuthology.orchestra.run.trial101:> sudo chmod 0666 /tmp/tmp.5tS8KvrpNu 2026-02-22T22:32:40.209 DEBUG:teuthology.orchestra.remote:trial101:/tmp/tmp.5tS8KvrpNu is 303KB 2026-02-22T22:32:40.270 DEBUG:teuthology.orchestra.run.trial101:> rm -fr /tmp/tmp.5tS8KvrpNu 2026-02-22T22:32:40.275 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-22T22:32:40.276 DEBUG:teuthology.orchestra.run.trial061:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-22T22:32:40.278 DEBUG:teuthology.orchestra.run.trial101:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-22T22:32:40.332 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-22T22:32:40.370 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-22T22:32:40.370 INFO:tasks.ceph:Archiving crash dumps... 2026-02-22T22:32:40.373 DEBUG:teuthology.misc:Transferring archived files from trial061:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64197/remote/trial061/crash 2026-02-22T22:32:40.374 DEBUG:teuthology.orchestra.run.trial061:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-22T22:32:40.382 DEBUG:teuthology.misc:Transferring archived files from trial101:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64197/remote/trial101/crash 2026-02-22T22:32:40.384 DEBUG:teuthology.orchestra.run.trial101:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-22T22:32:40.419 INFO:tasks.ceph:Compressing logs... 2026-02-22T22:32:40.419 DEBUG:teuthology.orchestra.run.trial061:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T22:32:40.426 DEBUG:teuthology.orchestra.run.trial101:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T22:32:40.434 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21632.log 2026-02-22T22:32:40.435 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22991.log 2026-02-22T22:32:40.435 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17600.log 2026-02-22T22:32:40.435 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21632.log.gz 2026-02-22T22:32:40.436 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22991.log.gz 2026-02-22T22:32:40.436 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23461.log 2026-02-22T22:32:40.436 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.17600.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.17600.log.gz --verbose 2026-02-22T22:32:40.436 INFO:teuthology.orchestra.run.trial061.stderr: -- /var/log/ceph/ceph-client.admin.23487.log 2026-02-22T22:32:40.436 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23461.log.gz 2026-02-22T22:32:40.436 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21004.log 2026-02-22T22:32:40.442 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22107.log 2026-02-22T22:32:40.443 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23487.log.gz 2026-02-22T22:32:40.443 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21190.log 2026-02-22T22:32:40.443 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21004.log.gz 2026-02-22T22:32:40.443 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23331.log 2026-02-22T22:32:40.443 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22107.log.gz/var/log/ceph/ceph-client.admin.21190.log: 2026-02-22T22:32:40.443 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21190.log.gz 2026-02-22T22:32:40.443 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21191.log 2026-02-22T22:32:40.443 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21029.log 2026-02-22T22:32:40.444 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23331.log: /var/log/ceph/ceph-client.admin.21191.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23331.log.gz 2026-02-22T22:32:40.444 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21191.log.gz 2026-02-22T22:32:40.444 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.22788.log 2026-02-22T22:32:40.444 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21029.log.gz 2026-02-22T22:32:40.444 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21956.log 2026-02-22T22:32:40.444 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.23122.log 2026-02-22T22:32:40.444 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.0.22788.log: /var/log/ceph/ceph-client.admin.21956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21956.log.gz 2026-02-22T22:32:40.444 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22326.log 2026-02-22T22:32:40.445 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23069.log 2026-02-22T22:32:40.445 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.0.23122.log: /var/log/ceph/ceph-client.admin.22326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22326.log.gz 2026-02-22T22:32:40.445 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-22T22:32:40.445 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21193.log 2026-02-22T22:32:40.445 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23069.log.gz 2026-02-22T22:32:40.445 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20972.log 2026-02-22T22:32:40.445 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21193.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21193.log.gz 2026-02-22T22:32:40.445 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.23015.log 2026-02-22T22:32:40.445 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.20972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23201.log 2026-02-22T22:32:40.445 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20972.log.gz 2026-02-22T22:32:40.446 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.0.23015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21523.log 2026-02-22T22:32:40.446 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22271.log 2026-02-22T22:32:40.446 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23201.log.gz 2026-02-22T22:32:40.446 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21394.log 2026-02-22T22:32:40.446 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21523.log.gz 2026-02-22T22:32:40.446 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22271.log.gz 2026-02-22T22:32:40.446 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22297.log 2026-02-22T22:32:40.446 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21593.log 2026-02-22T22:32:40.446 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21394.log: /var/log/ceph/ceph-client.admin.22297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21394.log.gz 2026-02-22T22:32:40.446 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22297.log.gz 2026-02-22T22:32:40.446 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21380.log 2026-02-22T22:32:40.447 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21593.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.21593.log.gz /var/log/ceph/ceph-client.admin.23227.log 2026-02-22T22:32:40.447 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T22:32:40.469 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21382.log 2026-02-22T22:32:40.469 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21380.log.gz 2026-02-22T22:32:40.469 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23745.log 2026-02-22T22:32:40.469 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23227.log.gz 2026-02-22T22:32:40.469 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21382.log.gz 2026-02-22T22:32:40.469 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21092.log 2026-02-22T22:32:40.469 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21395.log 2026-02-22T22:32:40.469 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23745.log.gz 2026-02-22T22:32:40.469 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23617.log 2026-02-22T22:32:40.469 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21092.log.gz 2026-02-22T22:32:40.469 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21932.log 2026-02-22T22:32:40.469 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21395.log.gz 2026-02-22T22:32:40.469 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23617.log.gz 2026-02-22T22:32:40.470 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21196.log 2026-02-22T22:32:40.470 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23253.log 2026-02-22T22:32:40.470 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21932.log.gz 2026-02-22T22:32:40.470 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22655.log 2026-02-22T22:32:40.470 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21196.log.gz 2026-02-22T22:32:40.470 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-22T22:32:40.470 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23253.log.gz 2026-02-22T22:32:40.470 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22655.log.gz 2026-02-22T22:32:40.470 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21198.log 2026-02-22T22:32:40.470 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22191.log 2026-02-22T22:32:40.470 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.22350.log 2026-02-22T22:32:40.470 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21198.log.gz 2026-02-22T22:32:40.470 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21832.log 2026-02-22T22:32:40.470 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22191.log.gz 2026-02-22T22:32:40.470 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.0.22350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21858.log 2026-02-22T22:32:40.470 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22823.log 2026-02-22T22:32:40.470 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21832.log.gz 2026-02-22T22:32:40.470 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21586.log 2026-02-22T22:32:40.471 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21858.log.gz 2026-02-22T22:32:40.471 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22823.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22823.log.gz 2026-02-22T22:32:40.471 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22626.log 2026-02-22T22:32:40.471 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21908.log 2026-02-22T22:32:40.471 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21586.log.gz 2026-02-22T22:32:40.471 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22626.log.gz 2026-02-22T22:32:40.471 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22004.log 2026-02-22T22:32:40.471 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21908.log.gz 2026-02-22T22:32:40.471 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17415.log 2026-02-22T22:32:40.471 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22004.log.gz 2026-02-22T22:32:40.471 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21634.log 2026-02-22T22:32:40.471 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.17415.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17415.log.gz 2026-02-22T22:32:40.471 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23435.log 2026-02-22T22:32:40.471 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21634.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21634.log.gz 2026-02-22T22:32:40.471 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23565.log 2026-02-22T22:32:40.471 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22849.log 2026-02-22T22:32:40.471 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23435.log: /var/log/ceph/ceph-client.admin.23565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23435.log.gz 2026-02-22T22:32:40.471 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23565.log.gz 2026-02-22T22:32:40.472 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23409.log 2026-02-22T22:32:40.472 INFO:teuthology.orchestra.run.trial061.stderr:gzip/var/log/ceph/ceph-client.admin.22849.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.21884.log 2026-02-22T22:32:40.472 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22849.log.gz 2026-02-22T22:32:40.472 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23409.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.12472.log 2026-02-22T22:32:40.472 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23409.log.gz 2026-02-22T22:32:40.472 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21884.log.gz 2026-02-22T22:32:40.472 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22709.log 2026-02-22T22:32:40.472 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21195.log 2026-02-22T22:32:40.472 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph.tmp-client.admin.12472.log: /var/log/ceph/ceph-client.admin.22709.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.12472.log.gz 2026-02-22T22:32:40.472 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22709.log.gz 2026-02-22T22:32:40.472 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23149.log 2026-02-22T22:32:40.472 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21195.log.gz 2026-02-22T22:32:40.472 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23591.log 2026-02-22T22:32:40.472 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21118.log 2026-02-22T22:32:40.472 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23149.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23149.log.gz 2026-02-22T22:32:40.472 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23591.log.gz 2026-02-22T22:32:40.472 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23383.log 2026-02-22T22:32:40.473 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21402.log 2026-02-22T22:32:40.473 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21118.log.gz 2026-02-22T22:32:40.473 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23383.log.gz 2026-02-22T22:32:40.473 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22735.log 2026-02-22T22:32:40.473 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23305.log 2026-02-22T22:32:40.473 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21402.log.gz 2026-02-22T22:32:40.473 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23175.log 2026-02-22T22:32:40.473 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22735.log.gz 2026-02-22T22:32:40.473 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23305.log.gz 2026-02-22T22:32:40.473 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-22T22:32:40.473 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21806.log 2026-02-22T22:32:40.473 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23175.log.gz 2026-02-22T22:32:40.473 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17488.log 2026-02-22T22:32:40.473 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-22T22:32:40.473 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21806.log.gz 2026-02-22T22:32:40.473 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.17488.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17488.log.gz 2026-02-22T22:32:40.473 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22165.log 2026-02-22T22:32:40.474 INFO:teuthology.orchestra.run.trial061.stderr: 94.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-22T22:32:40.474 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21398.log 2026-02-22T22:32:40.474 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.22165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.22244.log 2026-02-22T22:32:40.474 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22165.log.gz 2026-02-22T22:32:40.474 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21398.log.gz 2026-02-22T22:32:40.474 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-22T22:32:40.474 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.0.22244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23513.log 2026-02-22T22:32:40.474 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-22T22:32:40.474 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23513.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23513.log.gz 2026-02-22T22:32:40.474 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21197.log 2026-02-22T22:32:40.474 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23669.log 2026-02-22T22:32:40.474 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21197.log.gz 2026-02-22T22:32:40.474 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22764.log 2026-02-22T22:32:40.474 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23669.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23669.log.gz 2026-02-22T22:32:40.474 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21630.log 2026-02-22T22:32:40.474 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22764.log.gz 2026-02-22T22:32:40.474 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23721.log 2026-02-22T22:32:40.474 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22600.log 2026-02-22T22:32:40.475 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21630.log.gz 2026-02-22T22:32:40.475 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23721.log.gz 2026-02-22T22:32:40.475 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22078.log 2026-02-22T22:32:40.475 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21384.log 2026-02-22T22:32:40.475 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22600.log.gz 2026-02-22T22:32:40.475 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22078.log.gz 2026-02-22T22:32:40.475 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21192.log 2026-02-22T22:32:40.475 INFO:teuthology.orchestra.run.trial061.stderr: 92.0% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-22T22:32:40.475 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22028.log 2026-02-22T22:32:40.475 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21384.log.gz 2026-02-22T22:32:40.475 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21192.log.gz 2026-02-22T22:32:40.475 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.22131.log 2026-02-22T22:32:40.475 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23043.log 2026-02-22T22:32:40.475 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22028.log.gz 2026-02-22T22:32:40.475 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.0.22131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21054.log 2026-02-22T22:32:40.475 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23043.log.gz 2026-02-22T22:32:40.475 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22052.log 2026-02-22T22:32:40.475 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23279.log 2026-02-22T22:32:40.475 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21054.log.gz 2026-02-22T22:32:40.476 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22052.log.gz 2026-02-22T22:32:40.476 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23098.log 2026-02-22T22:32:40.476 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23279.log.gz 2026-02-22T22:32:40.476 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21980.log 2026-02-22T22:32:40.476 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22962.log 2026-02-22T22:32:40.476 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23098.log.gz 2026-02-22T22:32:40.476 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21980.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21980.log.gz 2026-02-22T22:32:40.476 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.22906.log 2026-02-22T22:32:40.476 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22962.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22962.log.gz 2026-02-22T22:32:40.476 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21636.log 2026-02-22T22:32:40.476 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-22T22:32:40.476 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.0.22906.log: /var/log/ceph/ceph-client.admin.21636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21636.log.gz 2026-02-22T22:32:40.476 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22878.log 2026-02-22T22:32:40.476 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose/var/log/ceph/ceph-osd.0.log: -- /var/log/ceph/ceph-client.admin.21633.log 2026-02-22T22:32:40.476 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22878.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22878.log.gz 2026-02-22T22:32:40.476 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23539.log 2026-02-22T22:32:40.476 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21144.log 2026-02-22T22:32:40.476 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21633.log: /var/log/ceph/ceph-client.admin.23539.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23539.log.gz 2026-02-22T22:32:40.477 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-22T22:32:40.477 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21633.log.gz 2026-02-22T22:32:40.477 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22936.log 2026-02-22T22:32:40.477 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.21144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21144.log.gz 2026-02-22T22:32:40.477 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2026-02-22T22:32:40.477 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22936.log.gz 2026-02-22T22:32:40.477 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21594.log 2026-02-22T22:32:40.477 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.22679.log 2026-02-22T22:32:40.477 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.21594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23695.log 2026-02-22T22:32:40.477 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21594.log.gz 2026-02-22T22:32:40.477 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.0.22679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23357.log 2026-02-22T22:32:40.477 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23695.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.23695.log.gz 2026-02-22T22:32:40.477 INFO:teuthology.orchestra.run.trial061.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.23643.log 2026-02-22T22:32:40.477 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22220.log 2026-02-22T22:32:40.477 INFO:teuthology.orchestra.run.trial061.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23357.log.gz 2026-02-22T22:32:40.477 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.23643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.23643.log.gz 2026-02-22T22:32:40.477 INFO:teuthology.orchestra.run.trial061.stderr:/var/log/ceph/ceph-client.admin.22220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.22220.log.gz 2026-02-22T22:32:40.481 INFO:teuthology.orchestra.run.trial101.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-22T22:32:40.481 INFO:teuthology.orchestra.run.trial101.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17496.log 2026-02-22T22:32:40.481 INFO:teuthology.orchestra.run.trial101.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17351.log 2026-02-22T22:32:40.481 INFO:teuthology.orchestra.run.trial101.stderr:gzip/var/log/ceph/ceph-client.admin.17496.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.17375.log 2026-02-22T22:32:40.481 INFO:teuthology.orchestra.run.trial101.stderr:/var/log/ceph/ceph-client.admin.17351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17496.log.gz 2026-02-22T22:32:40.481 INFO:teuthology.orchestra.run.trial101.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17351.log.gz 2026-02-22T22:32:40.481 INFO:teuthology.orchestra.run.trial101.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-22T22:32:40.481 INFO:teuthology.orchestra.run.trial101.stderr:/var/log/ceph/ceph-client.admin.17375.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-22T22:32:40.481 INFO:teuthology.orchestra.run.trial101.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17375.log.gz 2026-02-22T22:32:40.481 INFO:teuthology.orchestra.run.trial101.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2026-02-22T22:32:40.481 INFO:teuthology.orchestra.run.trial101.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17399.log 2026-02-22T22:32:40.481 INFO:teuthology.orchestra.run.trial101.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17520.log 2026-02-22T22:32:40.481 INFO:teuthology.orchestra.run.trial101.stderr:/var/log/ceph/ceph-client.admin.17399.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2026-02-22T22:32:40.481 INFO:teuthology.orchestra.run.trial101.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17399.log.gz 2026-02-22T22:32:40.481 INFO:teuthology.orchestra.run.trial101.stderr:/var/log/ceph/ceph-client.admin.17520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17448.log 2026-02-22T22:32:40.481 INFO:teuthology.orchestra.run.trial101.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17520.log.gz 2026-02-22T22:32:40.482 INFO:teuthology.orchestra.run.trial101.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17423.log 2026-02-22T22:32:40.482 INFO:teuthology.orchestra.run.trial101.stderr:/var/log/ceph/ceph-client.admin.17448.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-22T22:32:40.482 INFO:teuthology.orchestra.run.trial101.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17448.log.gz 2026-02-22T22:32:40.482 INFO:teuthology.orchestra.run.trial101.stderr:/var/log/ceph/ceph-client.admin.17423.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-22T22:32:40.482 INFO:teuthology.orchestra.run.trial101.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17423.log.gz 2026-02-22T22:32:40.482 INFO:teuthology.orchestra.run.trial101.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-22T22:32:40.482 INFO:teuthology.orchestra.run.trial101.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17472.log 2026-02-22T22:32:40.482 INFO:teuthology.orchestra.run.trial101.stderr:/var/log/ceph/ceph-osd.4.log: 90.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-22T22:32:40.482 INFO:teuthology.orchestra.run.trial101.stderr:/var/log/ceph/ceph-client.admin.17472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.17472.log.gz 2026-02-22T22:32:40.482 INFO:teuthology.orchestra.run.trial101.stderr: 85.9% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-22T22:32:40.482 INFO:teuthology.orchestra.run.trial061.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2026-02-22T22:32:40.504 INFO:teuthology.orchestra.run.trial061.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.0.23122.log.gz 2026-02-22T22:32:40.513 INFO:teuthology.orchestra.run.trial061.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.0.22350.log.gz 2026-02-22T22:32:40.521 INFO:teuthology.orchestra.run.trial061.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.0.22244.log.gz 2026-02-22T22:32:40.523 INFO:teuthology.orchestra.run.trial061.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.0.23015.log.gz 2026-02-22T22:32:40.523 INFO:teuthology.orchestra.run.trial061.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.0.22788.log.gz 2026-02-22T22:32:40.531 INFO:teuthology.orchestra.run.trial061.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.0.22906.log.gz 2026-02-22T22:32:40.534 INFO:teuthology.orchestra.run.trial061.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.0.22131.log.gz 2026-02-22T22:32:40.541 INFO:teuthology.orchestra.run.trial101.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-22T22:32:40.551 INFO:teuthology.orchestra.run.trial061.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.0.22679.log.gz 2026-02-22T22:32:40.553 INFO:teuthology.orchestra.run.trial061.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-22T22:32:40.616 INFO:teuthology.orchestra.run.trial101.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-22T22:32:40.691 INFO:teuthology.orchestra.run.trial061.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-22T22:32:42.516 INFO:teuthology.orchestra.run.trial101.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2026-02-22T22:32:42.521 INFO:teuthology.orchestra.run.trial061.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-22T22:32:42.682 INFO:teuthology.orchestra.run.trial061.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-22T22:32:42.757 INFO:teuthology.orchestra.run.trial101.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2026-02-22T22:32:42.778 INFO:teuthology.orchestra.run.trial061.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-22T22:32:43.048 INFO:teuthology.orchestra.run.trial061.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-22T22:32:43.049 INFO:teuthology.orchestra.run.trial061.stderr: 2026-02-22T22:32:43.049 INFO:teuthology.orchestra.run.trial061.stderr:real 0m2.621s 2026-02-22T22:32:43.049 INFO:teuthology.orchestra.run.trial061.stderr:user 0m9.766s 2026-02-22T22:32:43.049 INFO:teuthology.orchestra.run.trial061.stderr:sys 0m0.474s 2026-02-22T22:32:43.209 INFO:teuthology.orchestra.run.trial101.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-22T22:32:43.244 INFO:teuthology.orchestra.run.trial101.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-22T22:32:43.245 INFO:teuthology.orchestra.run.trial101.stderr: 2026-02-22T22:32:43.246 INFO:teuthology.orchestra.run.trial101.stderr:real 0m2.778s 2026-02-22T22:32:43.246 INFO:teuthology.orchestra.run.trial101.stderr:user 0m9.653s 2026-02-22T22:32:43.246 INFO:teuthology.orchestra.run.trial101.stderr:sys 0m0.394s 2026-02-22T22:32:43.246 INFO:tasks.ceph:Archiving logs... 2026-02-22T22:32:43.246 DEBUG:teuthology.misc:Transferring archived files from trial061:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64197/remote/trial061/log 2026-02-22T22:32:43.247 DEBUG:teuthology.orchestra.run.trial061:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-22T22:32:44.179 DEBUG:teuthology.misc:Transferring archived files from trial101:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64197/remote/trial101/log 2026-02-22T22:32:44.180 DEBUG:teuthology.orchestra.run.trial101:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-22T22:32:45.063 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-22T22:32:45.076 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-22T22:32:45.076 DEBUG:teuthology.orchestra.run.trial061:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-22T22:32:45.077 DEBUG:teuthology.orchestra.run.trial101:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-22T22:32:45.217 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-22T22:32:45.229 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-22T22:32:45.229 DEBUG:teuthology.orchestra.run.trial061:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T22:32:45.230 DEBUG:teuthology.orchestra.run.trial101:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-22T22:32:45.275 INFO:teuthology.orchestra.run.trial101.stdout: remote refid st t when poll reach delay offset jitter 2026-02-22T22:32:45.276 INFO:teuthology.orchestra.run.trial101.stdout:============================================================================== 2026-02-22T22:32:45.276 INFO:teuthology.orchestra.run.trial101.stdout:+rn-03.koehn.com 17.253.83.251 2 u 58 64 377 72.167 +0.589 1.032 2026-02-22T22:32:45.276 INFO:teuthology.orchestra.run.trial101.stdout:-23.186.168.130 132.163.97.4 2 u 125 64 336 69.690 -1.316 5.520 2026-02-22T22:32:45.276 INFO:teuthology.orchestra.run.trial101.stdout:+198.137.202.32 17.253.16.125 2 u 59 64 377 64.644 -1.287 2.308 2026-02-22T22:32:45.276 INFO:teuthology.orchestra.run.trial101.stdout:*chi2.us.ntp.li 204.9.54.119 2 u 57 64 377 19.600 -0.085 0.806 2026-02-22T22:32:45.284 INFO:teuthology.orchestra.run.trial061.stdout: remote refid st t when poll reach delay offset jitter 2026-02-22T22:32:45.284 INFO:teuthology.orchestra.run.trial061.stdout:============================================================================== 2026-02-22T22:32:45.284 INFO:teuthology.orchestra.run.trial061.stdout:+rn-03.koehn.com 17.253.83.251 2 u 1 64 377 72.167 +2.268 0.823 2026-02-22T22:32:45.284 INFO:teuthology.orchestra.run.trial061.stdout:-23-93-251-54.de .PPS. 1 u 56 64 377 68.530 +2.075 0.829 2026-02-22T22:32:45.284 INFO:teuthology.orchestra.run.trial061.stdout:+198.137.202.32 17.253.16.125 2 u 47 64 377 64.602 +1.929 2.152 2026-02-22T22:32:45.284 INFO:teuthology.orchestra.run.trial061.stdout:*dns-e.ns4v.icu 228.188.15.147 2 u 64 64 377 61.727 +1.154 0.648 2026-02-22T22:32:45.285 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-22T22:32:45.296 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-22T22:32:45.296 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-22T22:32:45.310 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-22T22:32:45.324 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-22T22:32:45.338 INFO:teuthology.task.internal:Duration was 1131.875513 seconds 2026-02-22T22:32:45.338 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-22T22:32:45.352 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-22T22:32:45.353 DEBUG:teuthology.orchestra.run.trial061:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-22T22:32:45.354 DEBUG:teuthology.orchestra.run.trial101:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-22T22:32:45.380 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-22T22:32:45.380 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial061.front.sepia.ceph.com 2026-02-22T22:32:45.380 DEBUG:teuthology.orchestra.run.trial061:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-22T22:32:45.427 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial101.front.sepia.ceph.com 2026-02-22T22:32:45.427 DEBUG:teuthology.orchestra.run.trial101:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-22T22:32:45.434 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-22T22:32:45.434 DEBUG:teuthology.orchestra.run.trial061:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T22:32:45.470 DEBUG:teuthology.orchestra.run.trial101:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T22:32:45.695 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-22T22:32:45.695 DEBUG:teuthology.orchestra.run.trial061:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T22:32:45.696 DEBUG:teuthology.orchestra.run.trial101:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-22T22:32:45.704 INFO:teuthology.orchestra.run.trial101.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T22:32:45.706 INFO:teuthology.orchestra.run.trial101.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T22:32:45.706 INFO:teuthology.orchestra.run.trial101.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-22T22:32:45.706 INFO:teuthology.orchestra.run.trial101.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T22:32:45.706 INFO:teuthology.orchestra.run.trial101.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-22T22:32:45.706 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-22T22:32:45.707 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-22T22:32:45.707 INFO:teuthology.orchestra.run.trial061.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-22T22:32:45.707 INFO:teuthology.orchestra.run.trial061.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-22T22:32:45.707 INFO:teuthology.orchestra.run.trial061.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-22T22:32:45.774 INFO:teuthology.orchestra.run.trial061.stderr: 81.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-22T22:32:45.775 INFO:teuthology.orchestra.run.trial101.stderr: 81.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-22T22:32:45.776 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-22T22:32:45.792 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-22T22:32:45.793 DEBUG:teuthology.orchestra.run.trial061:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-22T22:32:45.825 DEBUG:teuthology.orchestra.run.trial101:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-22T22:32:45.833 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-22T22:32:45.849 DEBUG:teuthology.orchestra.run.trial061:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-22T22:32:45.867 DEBUG:teuthology.orchestra.run.trial101:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-22T22:32:45.872 INFO:teuthology.orchestra.run.trial061.stdout:kernel.core_pattern = core 2026-02-22T22:32:45.882 INFO:teuthology.orchestra.run.trial101.stdout:kernel.core_pattern = core 2026-02-22T22:32:45.893 DEBUG:teuthology.orchestra.run.trial061:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-22T22:32:45.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:32:45.929 DEBUG:teuthology.orchestra.run.trial101:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-22T22:32:45.938 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-22T22:32:45.939 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-22T22:32:45.955 INFO:teuthology.task.internal:Transferring archived files... 2026-02-22T22:32:45.956 DEBUG:teuthology.misc:Transferring archived files from trial061:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64197/remote/trial061 2026-02-22T22:32:45.957 DEBUG:teuthology.orchestra.run.trial061:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-22T22:32:46.010 DEBUG:teuthology.misc:Transferring archived files from trial101:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-22_19:35:40-rados-wip-yuri6-testing-2026-02-22-1629-squid-distro-default-trial/64197/remote/trial101 2026-02-22T22:32:46.010 DEBUG:teuthology.orchestra.run.trial101:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-22T22:32:46.043 INFO:teuthology.task.internal:Removing archive directory... 2026-02-22T22:32:46.043 DEBUG:teuthology.orchestra.run.trial061:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-22T22:32:46.045 DEBUG:teuthology.orchestra.run.trial101:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-22T22:32:46.080 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-22T22:32:46.099 INFO:teuthology.task.internal:Not uploading archives. 2026-02-22T22:32:46.099 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-22T22:32:46.120 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-22T22:32:46.120 DEBUG:teuthology.orchestra.run.trial061:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-22T22:32:46.122 DEBUG:teuthology.orchestra.run.trial101:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-22T22:32:46.126 INFO:teuthology.orchestra.run.trial061.stdout: 1179659 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 22 22:32 /home/ubuntu/cephtest 2026-02-22T22:32:46.128 INFO:teuthology.orchestra.run.trial101.stdout: 1179659 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 22 22:32 /home/ubuntu/cephtest 2026-02-22T22:32:46.129 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-22T22:32:46.147 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-22T22:32:46.172 INFO:teuthology.run:Summary data: description: rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/read mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} duration: 1131.8755128383636 flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com success: true 2026-02-22T22:32:46.172 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-22T22:32:46.277 INFO:teuthology.run:pass